Oct 30 21:51:34.425614 ip-10-0-137-32 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 21:51:34.425623 ip-10-0-137-32 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 21:51:34.425630 ip-10-0-137-32 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 21:51:34.425845 ip-10-0-137-32 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 21:51:44.427021 ip-10-0-137-32 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 21:51:44.427034 ip-10-0-137-32 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f729a21e3c064108b6ee9d5ea834bc41 --
Oct 30 21:53:30.796002 ip-10-0-137-32 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 21:53:31.192763 ip-10-0-137-32 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:53:31.192763 ip-10-0-137-32 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 21:53:31.192763 ip-10-0-137-32 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:53:31.192763 ip-10-0-137-32 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:53:31.198449 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198372    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:53:31.198449 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198449    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198453    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198456    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198459    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198462    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198464    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198467    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198470    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198473    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198475    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198478    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198480    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198483    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198486    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198488    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198491    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198493    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198496    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198500    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:53:31.198516 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198503    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198505    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198508    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198510    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198513    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198516    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198518    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198521    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198524    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198526    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198529    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198532    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198534    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198537    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198539    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198542    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198545    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198549    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198553    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:53:31.198969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198556    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198559    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198562    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198564    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198567    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198569    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198572    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198574    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198577    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198579    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198582    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198584    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198587    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198590    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198594    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198597    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198600    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198603    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198605    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198608    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:53:31.199409 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198611    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198613    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198616    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198619    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198621    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198624    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198626    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198630    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198632    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198635    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198638    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198640    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198643    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198645    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198647    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198650    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198653    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198655    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198658    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198660    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198663    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:53:31.199921 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198665    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198669    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198673    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198676    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198679    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198683    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198686    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198689    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198692    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198694    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198697    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198712    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198716    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198718    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198721    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198724    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198726    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198729    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198753    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:53:31.200415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198757    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198761    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198763    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198766    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198771    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198774    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.198776    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200247    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200256    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200260    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200263    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200266    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200269    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200272    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200275    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200277    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200280    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200283    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200286    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:53:31.200887 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200290    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200293    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200296    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200298    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200301    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200303    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200306    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200308    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200311    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200313    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200316    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200318    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200321    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200325    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200329    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200332    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200335    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200338    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200341    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:53:31.201541 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200344    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200346    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200349    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200351    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200354    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200356    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200359    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200361    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200364    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200366    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200369    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200372    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200374    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200378    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200381    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200384    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200387    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200389    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200392    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200395    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200397    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:53:31.202161 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200399    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200402    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200405    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200407    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200410    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200412    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200415    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200417    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200421    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200423    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200426    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200428    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200431    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200434    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200436    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200439    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200441    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200444    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200447    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:53:31.202696 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200449    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200451    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200454    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200456    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200459    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200463    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200465    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200468    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200471    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200473    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200476    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200479    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200481    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200483    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200486    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200489    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200491    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200494    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200496    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:53:31.203233 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200499    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200502    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200504    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200507    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200510    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200512    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200517    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200521    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200524    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200527    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200529    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200532    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200535    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200537    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200540    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.200542    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.201835    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.201862    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.201868    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:53:31.203692 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.201880    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.201888    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.201910    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.201918    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.201924    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.201935    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.201940    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.201949    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.201954    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.201975    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202094    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202103    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202108    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202111    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202114    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202117    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202119    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202122    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202125    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202127    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:53:31.204186 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202130    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202133    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202137    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202139    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202142    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202144    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202147    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202150    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202153    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202156    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202159    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202162    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202164    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202167    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202170    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202172    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202180    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202183    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202186    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202188    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:53:31.204658 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202191    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202194    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202196    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202199    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202201    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202204    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202206    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202209    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202211    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202214    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202216    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202219    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202221    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202224    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202226    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202229    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202236    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202241    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202244    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202247    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:53:31.205133 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202249    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202252    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202256    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202258    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202261    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202264    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202266    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202270    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202272    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202275    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202278    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202280    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202283    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202286    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202288    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202291    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202293    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202296    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202298    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:53:31.205589 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202301    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202303    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202306    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202309    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202311    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202314    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202316    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202319    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202321    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202324    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202326    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202329    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202331    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202334    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202337    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202340    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202342    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202345    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202347    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:53:31.206044 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202350    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202353    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202355    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202359    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.202362    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203196    2575 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203206    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203213    2575 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203218    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203223    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203226    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203231    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203235    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203239    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203242    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203247    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203251    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203254    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203257    2575 flags.go:64] FLAG: --cgroup-root=""
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203261    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203264    2575 flags.go:64] FLAG: --client-ca-file=""
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203267    2575 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203270    2575 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 21:53:31.206483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203275    2575 flags.go:64] FLAG: --cluster-domain=""
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203278    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203281    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203285    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203288    2575 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203292    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203295    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203298    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203301    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203304    2575 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203308    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203310    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203313    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203316    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203321    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203324    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203327    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203330    2575 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203333    2575 flags.go:64] FLAG: --enable-server="true"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203337    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203341    2575 flags.go:64] FLAG: --event-burst="100"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203345    2575 flags.go:64] FLAG: --event-qps="50"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203348    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203351    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 21:53:31.207035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203354    2575 flags.go:64] FLAG: --eviction-hard=""
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203358    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203365    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203368    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203371    2575 flags.go:64] FLAG: --eviction-soft=""
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203374    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203377    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203380    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203383    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203386    2575 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203391    2575 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203394    2575 flags.go:64] FLAG: --feature-gates=""
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203398    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203401    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203404    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203407    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203411    2575 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203414    2575 flags.go:64] FLAG: --help="false"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203417    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203420    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203423    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203427    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203430    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 21:53:31.207644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203434    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203436    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203439    2575 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203442    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203445    2575 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203448    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203451    2575 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203454    2575 flags.go:64] FLAG: --kube-reserved=""
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203457    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203460    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203463    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203467    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203470    2575 flags.go:64] FLAG: --lock-file=""
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203473    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203476    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203479    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203484    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203487    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203490    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203495    2575 flags.go:64] FLAG: --logging-format="text"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203498    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203502    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203505    2575 flags.go:64] FLAG: --manifest-url=""
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203508    2575 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203513    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 21:53:31.208216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203516    2575 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203520    2575 flags.go:64] FLAG: --max-pods="110"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203523    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203526    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203529    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203532    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203535    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203538    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203541    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203548    2575 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203551    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203554    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203557    2575 flags.go:64] FLAG: --pod-cidr=""
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203560    2575 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203563    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203566    2575 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203569    2575 flags.go:64] FLAG: --port="10250"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203572    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203576    2575 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0b947b003c19ca0f0"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203580    2575 flags.go:64] FLAG: --qos-reserved=""
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203583    2575 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203586    2575 flags.go:64] FLAG: --register-node="true"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203589    2575 flags.go:64] FLAG: --register-with-taints=""
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203593    2575 flags.go:64] FLAG: --registry-burst="10"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203596    2575 flags.go:64] FLAG: --registry-qps="5"
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203599    2575 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 21:53:31.208808 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203603    2575 flags.go:64] FLAG: --reserved-memory=""
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203607    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203610    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203613    2575 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203615    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203618    2575 flags.go:64] FLAG: --runonce="false"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203621    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203624    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203627    2575 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203631    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203633    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203637    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203640    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203642    2575 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203645    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203648    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203651    2575 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203654    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203657    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203660    2575 flags.go:64] FLAG: --system-cgroups=""
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203662    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203669    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203671    2575 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203674    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203680    2575 flags.go:64] FLAG: --tls-min-version=""
Oct 30 21:53:31.209410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203683    2575 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203686    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203690    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203692    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203696    2575 flags.go:64] FLAG: --v="2"
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203712    2575 flags.go:64] FLAG: --version="false"
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203717    2575 flags.go:64] FLAG: --vmodule=""
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203723    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.203726    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203864    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203867    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203870    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203873    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203876    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203878    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203881    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203884    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203886    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203889    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203891    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203894    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:53:31.210033 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203897    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203899    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203902    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203904    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203907    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203909    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203912    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203915    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203917    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203921    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203926    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203929    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203932    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203936    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203940    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203943    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203946    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203949    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:53:31.210528 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203953    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203955    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203958    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203960    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203963    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203966    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203968    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203971    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203974    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203976    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203979    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203981    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203984    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203986    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203989    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203991    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203994    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203997    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.203999    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204002    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:53:31.210969 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204004    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204007    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204009    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204011    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204016    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204018    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204021    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204023    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204026    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204029    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204032    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204034    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204038    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204040    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204043    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204046    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204048    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204051    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204053    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204056    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:53:31.211475 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204058    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204061    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204063    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204066    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204069    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204071    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204074    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204076    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204079    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204081    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204084    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204086    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204089    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204091    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204094    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204097    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204100    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204103    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204105    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204108    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:53:31.211966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204110    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204115    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204117    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204120    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204123    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204126    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204128    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204131    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204133    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204136    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204139    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204141    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204144    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204146    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204149    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204151    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:53:31.212433 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.204185    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204240    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204244    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204248    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204251    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204254    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204257    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204259    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204262    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204264    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204267    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204269    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204273    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204276    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204279    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204281    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204284    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204287    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204290    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204293    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:53:31.212831 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204296    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204299    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204302    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204305    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204307    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204310    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204313    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204315    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204318    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204320    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204323    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204326    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204328    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204331    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204333    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204336    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204338    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204341    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204343    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204346    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:53:31.213308 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204348    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204351    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204353    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204356    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204359    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204362    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204364    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204367    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204369    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204372    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204374    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204378    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204380    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204384    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204387    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204390    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204392    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204395    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204397    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204400    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:53:31.213791 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204402    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204405    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204407    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204410    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204412    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204415    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204417    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204420    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204423    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204425    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204428    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204430    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204433    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204435    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204438    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204441    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204445    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204447    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204450    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204453    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:53:31.214252 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204455    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204458    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204460    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204463    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204466    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204470    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204473    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204476    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204479    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204481    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204483    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204486    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204489    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204491    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204494    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204497    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204501    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204504    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204507    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:53:31.214722 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204509    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204514    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204518    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204521    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204524    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204527    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204530    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.204532    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.213047    2575 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.213063    2575 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.213080    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.213085    2575 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213139    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213145    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213149    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213152    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213155    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213159    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:53:31.215160 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213164    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213167    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213170    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213173    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213176    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213179    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213181    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213184    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213187    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213189    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213192    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213195    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213197    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213200    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213203    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213206    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213209    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213211    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213214    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213216    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:53:31.215594 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213219    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213222    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213224    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213229    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213232    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213234    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213237    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213240    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213242    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213245    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213248    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213250    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213253    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213255    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213258    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213260    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213263    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213265    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213268    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:53:31.216190 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213270    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213273    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213276    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213278    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213281    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213283    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213286    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213289    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213291    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213294    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213296    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213298    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213302    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213305    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213307    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213310    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213313    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213317    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213320    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:53:31.216641 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213323    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213325    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213328    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213330    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213334    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213338    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213341    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213343    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213346    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213349    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213352    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213354    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213356    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213359    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213362    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213364    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213367    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213369    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213372    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:53:31.217142 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213374    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213377    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213380    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213382    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213385    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213387    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213390    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213393    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213395    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213398    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213401    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213403    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213407    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213409    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213412    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213414    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213417    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213419    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213422    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213424    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:53:31.217599 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213427    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213429    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213432    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.213459    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213592    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213597    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213600    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213603    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213606    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213608    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213611    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213614    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213617    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213619    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213622    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213624    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:53:31.218077 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213627    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213630    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213632    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213635    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213638    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213640    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213643    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213646    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213649    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213652    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213654    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213657    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213660    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213662    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213665    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213667    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213670    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213673    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213675    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213678    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:53:31.218451 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213680    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213683    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213685    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213688    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213691    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213693    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213696    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213699    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213713    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213716    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213718    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213721    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213724    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213727    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213729    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213732    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213735    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213738    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213740    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:53:31.218945 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213743    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213745    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213748    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213751    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213754    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213756    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213758    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213761    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213764    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213767    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213769    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213772    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213774    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213777    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213779    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213782    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213785    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213787    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213790    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213793    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:53:31.219402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213795    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213798    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213801    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213803    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213807    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213811    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213815    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213818    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213821    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213823    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213826    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213829    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213831    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213834    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213836    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213839    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213842    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213844    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:53:31.219881 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213847    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213851    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213854    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213858    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213861    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213863    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213866    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213868    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213871    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213873    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213876    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213879    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213881    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213883    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213886    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213889    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:53:31.220441 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213891    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.213914    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213947    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213951    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213954    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213957    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213960    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213963    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213965    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213968    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213970    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213973    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213975    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213978    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213980    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213984    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:53:31.221012 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213986    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213989    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213991    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213994    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213996    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.213999    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214001    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214004    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214007    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214009    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214012    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214014    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214017    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214019    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214022    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214024    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214027    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214029    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214032    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214034    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:53:31.221502 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214037    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214039    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214042    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214044    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214047    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214049    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214052    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214054    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214057    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214059    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214062    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214065    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214068    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214071    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214073    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214075    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214078    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214081    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214083    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214085    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:53:31.222014 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214088    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214090    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214093    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214096    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214099    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214101    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214103    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214106    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214108    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214111    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214113    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214116    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214118    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214121    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214124    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214128    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214131    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214134    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214137    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214139    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:53:31.222478 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214143    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214146    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214148    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214151    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214154    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214157    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214159    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214162    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214165    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214167    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214171    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214175    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214178    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214181    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214183    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214186    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214189    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214193    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:53:31.222966 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214195    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214198    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214200    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214203    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214205    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214209    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214212    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214214    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214217    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214219    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214222    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214224    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214227    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:31.214229    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.214282    2575 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.216790    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.217603    2575 server.go:1014] "Starting client certificate rotation"
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.217698    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:53:31.223447 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.218314    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:53:31.224046 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.219110    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:53:31.224046 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.220183    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:53:31.230882 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.230860    2575 log.go:25] "Validated CRI v1 runtime API"
Oct 30 21:53:31.233679 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.233663    2575 log.go:25] "Validated CRI v1 image API"
Oct 30 21:53:31.234500 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.234475    2575 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 21:53:31.239343 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.239320    2575 fs.go:135] Filesystem UUIDs: map[6db16b9e-f173-4bb0-a5ec-ed679786b0d5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b84158c4-0e7a-459b-b306-22737c3db4d8:/dev/nvme0n1p3]
Oct 30 21:53:31.239419 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.239342    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 21:53:31.245485 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.245374    2575 manager.go:217] Machine: {Timestamp:2026-10-30 21:53:31.244073291 +0000 UTC m=+0.350901506 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3116232 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dced3fdfbc2f8809bd5d3b7022881 SystemUUID:ec2dced3-fdfb-c2f8-809b-d5d3b7022881 BootID:f729a21e-3c06-4108-b6ee-9d5ea834bc41 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:75:67:2f:43:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:75:67:2f:43:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:cb:df:a0:a1:ca Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 21:53:31.245485 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.245483    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 21:53:31.245589 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.245559    2575 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 21:53:31.249481 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.249459    2575 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 21:53:31.249603 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.249481    2575 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-32.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 21:53:31.249644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.249605    2575 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 21:53:31.249644 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.249613    2575 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 21:53:31.249696 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.249647    2575 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:53:31.249696 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.249665    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:53:31.250337 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.250327    2575 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 21:53:31.252917 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.252906    2575 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 21:53:31.253025 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.253015    2575 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 21:53:31.253631 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.253622    2575 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 21:53:31.253660 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.253634    2575 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 21:53:31.253660 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.253644    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 21:53:31.253660 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.253653    2575 kubelet.go:405] "Adding apiserver pod source"
Oct 30 21:53:31.253660 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.253661    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 21:53:31.254005 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.253992    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:53:31.256072 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.256049    2575 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 21:53:31.260625 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.260610    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:53:31.261314 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.261299    2575 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 21:53:31.261354 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.261332    2575 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 21:53:31.261518 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.261506    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 21:53:31.261547 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.261525    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 21:53:31.261547 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.261532    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 21:53:31.261547 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.261537    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 21:53:31.261547 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.261543    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 21:53:31.261547 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.261548    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 21:53:31.261978 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.261969    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 21:53:31.262012 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.261979    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 21:53:31.262012 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.261986    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 21:53:31.262012 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.261992    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 21:53:31.262012 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.262001    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 21:53:31.262012 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.262010    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 21:53:31.262515 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.262506    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 21:53:31.262547 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.262519    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 21:53:31.266078 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.266060    2575 server.go:1263] "Started kubelet"
Oct 30 21:53:31.266177 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.266134    2575 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 21:53:31.266237 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.266165    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 21:53:31.266586 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.266568    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 21:53:31.266786 ip-10-0-137-32 systemd[1]: Started Kubernetes Kubelet.
Oct 30 21:53:31.267682 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.267552    2575 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 21:53:31.270321 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.269547    2575 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 21:53:31.271819 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:31.271798    2575 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 21:53:31.272410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.272389    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 21:53:31.272908 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.272893    2575 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 21:53:31.273016 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:31.272998    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-32.us-west-1.compute.internal\" not found"
Oct 30 21:53:31.273749 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.273732    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 21:53:31.273838 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.273672    2575 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 21:53:31.273933 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.273914    2575 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 21:53:31.274043 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.274014    2575 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 21:53:31.274043 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.274024    2575 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 21:53:31.274432 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.274413    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 21:53:31.274432 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.274433    2575 factory.go:55] Registering systemd factory
Oct 30 21:53:31.274559 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.274442    2575 factory.go:223] Registration of the systemd container factory successfully
Oct 30 21:53:31.274791 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.274774    2575 factory.go:153] Registering CRI-O factory
Oct 30 21:53:31.274859 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.274795    2575 factory.go:223] Registration of the crio container factory successfully
Oct 30 21:53:31.274859 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.274813    2575 factory.go:103] Registering Raw factory
Oct 30 21:53:31.274859 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.274826    2575 manager.go:1199] Started watching for new ooms in manager
Oct 30 21:53:31.275827 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.275807    2575 manager.go:319] Starting recovery of all containers
Oct 30 21:53:31.286069 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.286052    2575 manager.go:324] Recovery completed
Oct 30 21:53:31.289789 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.289775    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:53:31.291426 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.291395    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:53:31.291505 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.291443    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:53:31.291505 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.291458    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:53:31.291998 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.291982    2575 cpu_manager.go:226] "Starting" policy="none"
Oct 30 21:53:31.291998 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.291994    2575 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 21:53:31.292150 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.292010    2575 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 21:53:31.292150 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.291995    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:53:31.292739 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.292719    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:53:31.292812 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.292750    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:53:31.292812 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.292763    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:53:31.293088 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.293075    2575 policy_none.go:50] "Start"
Oct 30 21:53:31.293141 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.293093    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 21:53:31.293141 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.293107    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 21:53:31.294305 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.294292    2575 policy_none.go:44] "Start"
Oct 30 21:53:31.320383 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.320356    2575 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 21:53:31.325505 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.325493    2575 manager.go:341] "Starting Device Plugin manager"
Oct 30 21:53:31.325561 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:31.325518    2575 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 21:53:31.325561 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.325527    2575 server.go:87] "Starting device plugin registration server"
Oct 30 21:53:31.325772 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.325759    2575 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 21:53:31.325822 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.325775    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 21:53:31.325886 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.325867    2575 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 21:53:31.326003 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.325987    2575 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 21:53:31.326003 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.326002    2575 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 21:53:31.326569 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:31.326543    2575 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 21:53:31.326634 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:31.326597    2575 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-32.us-west-1.compute.internal\" not found"
Oct 30 21:53:31.407044 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.407018    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 21:53:31.408256 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.408239    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 21:53:31.408325 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.408264    2575 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 21:53:31.408325 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.408287    2575 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 21:53:31.408425 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:31.408326    2575 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 21:53:31.416786 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.416724    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-32.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 21:53:31.416786 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:31.416694    2575 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-32.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 21:53:31.420680 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:31.416723    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-32.us-west-1.compute.internal.18e36d4306b00f9e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-32.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-32.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:53:31.266027422 +0000 UTC m=+0.372855617,LastTimestamp:2026-10-30 21:53:31.266027422 +0000 UTC m=+0.372855617,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-32.us-west-1.compute.internal,}"
Oct 30 21:53:31.426763 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.426742    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:53:31.427513 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.427497    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:53:31.427599 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.427531    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:53:31.427599 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.427547    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:53:31.427599 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.427577    2575 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.495547 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.495366    2575 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 21:53:31.495547 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.495455    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5rbfq"
Oct 30 21:53:31.508421 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.508374    2575 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"]
Oct 30 21:53:31.508507 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.508456    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:53:31.509219 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.509205    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:53:31.509297 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.509230    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:53:31.509297 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.509243    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:53:31.510548 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.510537    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:53:31.510730 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.510699    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.510791 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.510745    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:53:31.511256 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.511237    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:53:31.511346 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.511268    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:53:31.511346 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.511278    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:53:31.511346 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.511237    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:53:31.511448 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.511346    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:53:31.511448 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.511359    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:53:31.512436 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.512416    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.512504 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.512445    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:53:31.513102 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.513086    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:53:31.513194 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.513116    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:53:31.513194 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.513131    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:53:31.546321 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:31.546301    2575 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-32.us-west-1.compute.internal\" not found" node="ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.549801 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:31.549785    2575 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-32.us-west-1.compute.internal\" not found" node="ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.575001 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.574982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45ec9fc5e2b74da3533af9e11f797bd9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"45ec9fc5e2b74da3533af9e11f797bd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.575058 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.575006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45ec9fc5e2b74da3533af9e11f797bd9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"45ec9fc5e2b74da3533af9e11f797bd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.575058 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.575021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13606120155d66241850ec4f52f0e0f4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"13606120155d66241850ec4f52f0e0f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.577565 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.577551    2575 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:53:31.578798 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.578785    2575 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:53:31.675458 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.675435    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45ec9fc5e2b74da3533af9e11f797bd9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"45ec9fc5e2b74da3533af9e11f797bd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.675581 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.675461    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45ec9fc5e2b74da3533af9e11f797bd9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"45ec9fc5e2b74da3533af9e11f797bd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.675581 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.675478    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13606120155d66241850ec4f52f0e0f4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"13606120155d66241850ec4f52f0e0f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.675581 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.675535    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13606120155d66241850ec4f52f0e0f4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"13606120155d66241850ec4f52f0e0f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.675581 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.675551    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45ec9fc5e2b74da3533af9e11f797bd9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"45ec9fc5e2b74da3533af9e11f797bd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.675733 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.675597    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45ec9fc5e2b74da3533af9e11f797bd9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"45ec9fc5e2b74da3533af9e11f797bd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.676040 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.676025    2575 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:53:31.676917 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.676901    2575 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:53:31.677451 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.677437    2575 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.773387 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.773312    2575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.849268 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.849247    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.853978 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.853333    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.902951 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.902928    2575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:53:31.903052 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.903037    2575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:53:31.961303 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:31.961282    2575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:53:34.215862 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.215844    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 21:53:34.216255 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.215980    2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 21:53:34.216255 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.215988    2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 21:53:34.216255 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.215994    2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 21:53:34.216255 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:34.216010    2575 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a2a55f6a5a807453fa6f77ca235301fa-4f791996f38f588f.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-137-32.us-west-1.compute.internal.18e36d4308343177\": read tcp 10.0.137.32:42428->3.136.217.54:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-137-32.us-west-1.compute.internal.18e36d4308343177  default   4755 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-32.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-32.us-west-1.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-32.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:53:31 +0000 UTC,LastTimestamp:2026-10-30 21:53:31.427552768 +0000 UTC m=+0.534380964,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-32.us-west-1.compute.internal,}"
Oct 30 21:53:34.252598 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.252578    2575 apiserver.go:52] "Watching apiserver"
Oct 30 21:53:34.270886 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.270865    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 21:53:34.497383 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.497305    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:48:33 +0000 UTC" deadline="2028-07-24 15:59:29.017526864 +0000 UTC"
Oct 30 21:53:34.497383 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.497334    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15186h5m54.520197251s"
Oct 30 21:53:34.525424 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.525399    2575 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 21:53:34.525712 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.525691    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-xpf4w","openshift-network-operator/iptables-alerter-9wkj7","kube-system/konnectivity-agent-hjj9v","openshift-network-diagnostics/network-check-target-6gnzt","kube-system/global-pull-secret-syncer-2hjmh","openshift-cluster-node-tuning-operator/tuned-kw6b8","openshift-image-registry/node-ca-p97r6","openshift-multus/multus-additional-cni-plugins-z4222","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9","openshift-dns/node-resolver-bvgp5","openshift-multus/multus-cs98z","openshift-ovn-kubernetes/ovnkube-node-nbrqj","kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"]
Oct 30 21:53:34.527401 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.527386    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:34.527463 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:34.527447    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:53:34.528477 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.528462    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:53:34.529581 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.529556    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:53:34.531683 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.531662    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:34.531776 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:34.531729    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:53:34.533008 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.532988    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:34.533110 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:34.533043    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:53:34.534190 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.534177    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.535474 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.535460    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:53:34.536660 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.536647    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.537978 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.537964    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.539016 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.539001    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:53:34.540130 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.540118    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.541437 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.541422    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.572394 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.572380    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 21:53:34.579272 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579254    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-modprobe-d\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.579339 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f63cc71d-ab0b-4137-9cce-a1c780acfb09-serviceca\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:53:34.579339 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579332    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-system-cni-dir\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.579417 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579391    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovnkube-config\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.579452 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579417    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovn-node-metrics-cert\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.579452 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg5j8\" (UniqueName: \"kubernetes.io/projected/4b832e76-992a-4ff5-abe5-44ec22eba0d1-kube-api-access-jg5j8\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.579543 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579455    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-device-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.579543 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-cni-bin\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.579543 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579498    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84f02cd4-68fb-43b2-bb98-86f2fd944aad-konnectivity-ca\") pod \"konnectivity-agent-hjj9v\" (UID: \"84f02cd4-68fb-43b2-bb98-86f2fd944aad\") " pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:53:34.579543 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579515    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-tuned\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.579730 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579564    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-socket-dir-parent\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.579730 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-hostroot\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.579730 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2feb206d-12b1-4761-96e2-321878073139-host-slash\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:53:34.579730 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579713    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-systemd-units\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.579884 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579758    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovnkube-script-lib\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.579884 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579785    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-sys-fs\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.579884 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5981da65-938a-4058-b3cb-459025feb5d6-dbus\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:34.579884 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysconfig\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.579884 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-lib-modules\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.580051 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-systemd\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.580051 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579936    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-ovn\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.580051 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk6wz\" (UniqueName: \"kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz\") pod \"network-check-target-6gnzt\" (UID: \"4110027a-d96e-4b82-8206-3f4c30cc5978\") " pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:34.580051 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.579990    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3390fc0f-4489-4c05-b017-475fdb9c5670-cni-binary-copy\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.580051 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-cni-multus\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.580051 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580047    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.580263 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-env-overrides\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.580263 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44sns\" (UniqueName: \"kubernetes.io/projected/434e8ae7-f2c1-4195-a22e-366bf3290d79-kube-api-access-44sns\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:53:34.580263 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-cni-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.580263 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580161    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-k8s-cni-cncf-io\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.580263 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580191    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-multus-certs\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.580263 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-etc-kubernetes\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.580521 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580267    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4nfk\" (UniqueName: \"kubernetes.io/projected/f63cc71d-ab0b-4137-9cce-a1c780acfb09-kube-api-access-z4nfk\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:53:34.580521 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580332    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-var-lib-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.580521 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-run-ovn-kubernetes\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.580521 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-log-socket\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.580521 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-kubelet\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.580521 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580458    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5981da65-938a-4058-b3cb-459025feb5d6-kubelet-config\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:34.580521 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-kubernetes\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.580521 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58eb124c-7ccc-43bf-89d9-72b023b94a27-tmp\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.580838 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-slash\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.580838 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580563    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vktq\" (UniqueName: \"kubernetes.io/projected/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-kube-api-access-8vktq\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:34.580838 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580604    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-netns\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.580838 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l685p\" (UniqueName: \"kubernetes.io/projected/58eb124c-7ccc-43bf-89d9-72b023b94a27-kube-api-access-l685p\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.580838 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.580838 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/434e8ae7-f2c1-4195-a22e-366bf3290d79-tmp-dir\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:53:34.580838 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580724    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84f02cd4-68fb-43b2-bb98-86f2fd944aad-agent-certs\") pod \"konnectivity-agent-hjj9v\" (UID: \"84f02cd4-68fb-43b2-bb98-86f2fd944aad\") " pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:53:34.580838 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580738    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-run-netns\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.580838 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.581201 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580843    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-daemon-config\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.581201 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfwd8\" (UniqueName: \"kubernetes.io/projected/3390fc0f-4489-4c05-b017-475fdb9c5670-kube-api-access-sfwd8\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.581201 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580895    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysctl-conf\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.581201 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-run\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.581201 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.580966    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-sys\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.581201 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f63cc71d-ab0b-4137-9cce-a1c780acfb09-host\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:53:34.581201 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581031    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-node-log\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.581201 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581062    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-system-cni-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.581201 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-cnibin\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.581201 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581121    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-systemd\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.581201 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581159    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-var-lib-kubelet\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.581201 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-host\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581218    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn8t9\" (UniqueName: \"kubernetes.io/projected/368dc546-ddd5-4dfb-8b14-426e6084bd63-kube-api-access-xn8t9\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581285    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-etc-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581348    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-socket-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581392    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-registration-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581421    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581463    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/434e8ae7-f2c1-4195-a22e-366bf3290d79-hosts-file\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581467    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s9wtv\""
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581488    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-cnibin\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581516    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-kubelet\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581552    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhw4h\" (UniqueName: \"kubernetes.io/projected/2feb206d-12b1-4761-96e2-321878073139-kube-api-access-xhw4h\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581584    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysctl-d\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581617    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.581760 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581633    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-cni-bin\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.582282 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-cni-netd\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.582282 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581713    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.582282 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581760    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2feb206d-12b1-4761-96e2-321878073139-iptables-alerter-script\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:53:34.582282 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.582282 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581805    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-conf-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.582282 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581835    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz52v\" (UniqueName: \"kubernetes.io/projected/28265d99-26ec-4182-a806-4aac326a4781-kube-api-access-hz52v\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.582282 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581995    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-vjl7c\""
Oct 30 21:53:34.582282 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.581994    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 21:53:34.582282 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.582075    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:53:34.582282 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.582129    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 21:53:34.582282 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.582131    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 21:53:34.582282 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.582166    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 21:53:34.586290 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.586271    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 21:53:34.586356 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.586292    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:53:34.586404 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.586386    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t4xfw\""
Oct 30 21:53:34.591648 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.591611    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 21:53:34.591732 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.591700    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4dnxg\""
Oct 30 21:53:34.591778 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.591752    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 21:53:34.591778 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.591766    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 21:53:34.591849 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.591818    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 21:53:34.591899 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.591848    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 21:53:34.591899 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.591861    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 21:53:34.591899 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.591864    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 21:53:34.591899 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.591872    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 21:53:34.591899 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.591889    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 21:53:34.591899 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.591897    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ghldd\""
Oct 30 21:53:34.592081 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.591908    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 21:53:34.592081 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.591915    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 21:53:34.592081 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.591918    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z7lww\""
Oct 30 21:53:34.628976 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.628952    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 21:53:34.631477 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.631454    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hbp5d\""
Oct 30 21:53:34.631581 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.631489    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 21:53:34.631581 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.631500    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pgbrx\""
Oct 30 21:53:34.631581 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.631547    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 21:53:34.631581 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.631549    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 21:53:34.631581 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.631567    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 21:53:34.631581 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.631568    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 21:53:34.635687 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.635671    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-8jkh4\""
Oct 30 21:53:34.635735 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.635701    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 21:53:34.635767 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.635747    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 21:53:34.640902 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.640886    2575 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 21:53:34.640955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.640919    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 21:53:34.640983 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.640976    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2xtxp"
Oct 30 21:53:34.682077 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-cnibin\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.682153 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682084    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-kubelet\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.682153 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682105    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhw4h\" (UniqueName: \"kubernetes.io/projected/2feb206d-12b1-4761-96e2-321878073139-kube-api-access-xhw4h\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:53:34.682153 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682131    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysctl-d\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.682252 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682153    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.682252 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682159    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-kubelet\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.682252 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682153    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-cnibin\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.682252 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682196    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.682252 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682217    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-cni-bin\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.682252 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682237    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-cni-netd\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682253    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2feb206d-12b1-4761-96e2-321878073139-iptables-alerter-script\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682286    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysctl-d\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682311    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-cni-netd\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682313    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682324    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-conf-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682331    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-cni-bin\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682347    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz52v\" (UniqueName: \"kubernetes.io/projected/28265d99-26ec-4182-a806-4aac326a4781-kube-api-access-hz52v\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682353    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682364    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-modprobe-d\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682371    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-conf-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682378    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f63cc71d-ab0b-4137-9cce-a1c780acfb09-serviceca\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-system-cni-dir\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682477    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-modprobe-d\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.682495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682495    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovnkube-config\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682512    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovn-node-metrics-cert\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682517    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-system-cni-dir\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg5j8\" (UniqueName: \"kubernetes.io/projected/4b832e76-992a-4ff5-abe5-44ec22eba0d1-kube-api-access-jg5j8\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682541    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-device-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682556    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-cni-bin\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682571    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84f02cd4-68fb-43b2-bb98-86f2fd944aad-konnectivity-ca\") pod \"konnectivity-agent-hjj9v\" (UID: \"84f02cd4-68fb-43b2-bb98-86f2fd944aad\") " pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-tuned\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682634    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-cni-bin\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-socket-dir-parent\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682674    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-hostroot\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682689    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2feb206d-12b1-4761-96e2-321878073139-host-slash\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-systemd-units\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682718    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovnkube-script-lib\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-sys-fs\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5981da65-938a-4058-b3cb-459025feb5d6-dbus\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682763    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysconfig\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.683135 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682762    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-socket-dir-parent\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-lib-modules\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-systemd\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682801    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-device-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-ovn\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682834    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-sys-fs\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk6wz\" (UniqueName: \"kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz\") pod \"network-check-target-6gnzt\" (UID: \"4110027a-d96e-4b82-8206-3f4c30cc5978\") " pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682856    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-hostroot\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682860    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3390fc0f-4489-4c05-b017-475fdb9c5670-cni-binary-copy\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-cni-multus\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682882    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2feb206d-12b1-4761-96e2-321878073139-host-slash\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682897    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682918    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-env-overrides\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682938    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-systemd-units\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682941    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44sns\" (UniqueName: \"kubernetes.io/projected/434e8ae7-f2c1-4195-a22e-366bf3290d79-kube-api-access-44sns\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682963    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-cni-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.682984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-k8s-cni-cncf-io\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-multus-certs\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.683955 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683031    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-etc-kubernetes\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683054    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4nfk\" (UniqueName: \"kubernetes.io/projected/f63cc71d-ab0b-4137-9cce-a1c780acfb09-kube-api-access-z4nfk\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-var-lib-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-run-ovn-kubernetes\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683121    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-log-socket\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683142    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-kubelet\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683119    2575 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683345    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f63cc71d-ab0b-4137-9cce-a1c780acfb09-serviceca\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683442    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-etc-kubernetes\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683483    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84f02cd4-68fb-43b2-bb98-86f2fd944aad-konnectivity-ca\") pod \"konnectivity-agent-hjj9v\" (UID: \"84f02cd4-68fb-43b2-bb98-86f2fd944aad\") " pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683496    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2feb206d-12b1-4761-96e2-321878073139-iptables-alerter-script\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683547    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovnkube-config\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683557    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-var-lib-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683561    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovnkube-script-lib\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683567    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-env-overrides\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683561    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-run-ovn-kubernetes\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683635    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-log-socket\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683640    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-kubelet\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.684837 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683647    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-k8s-cni-cncf-io\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683654    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5981da65-938a-4058-b3cb-459025feb5d6-dbus\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683674    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-ovn\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683684    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysconfig\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683687    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-multus-certs\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683701    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-cni-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683726    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-cni-multus\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683736    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-systemd\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683778    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-lib-modules\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5981da65-938a-4058-b3cb-459025feb5d6-kubelet-config\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683821    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-kubernetes\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58eb124c-7ccc-43bf-89d9-72b023b94a27-tmp\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683864    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5981da65-938a-4058-b3cb-459025feb5d6-kubelet-config\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683870    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-slash\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683888    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-kubernetes\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683904    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vktq\" (UniqueName: \"kubernetes.io/projected/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-kube-api-access-8vktq\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683916    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-slash\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-netns\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.685652 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683950    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l685p\" (UniqueName: \"kubernetes.io/projected/58eb124c-7ccc-43bf-89d9-72b023b94a27-kube-api-access-l685p\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.683975    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684001    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/434e8ae7-f2c1-4195-a22e-366bf3290d79-tmp-dir\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84f02cd4-68fb-43b2-bb98-86f2fd944aad-agent-certs\") pod \"konnectivity-agent-hjj9v\" (UID: \"84f02cd4-68fb-43b2-bb98-86f2fd944aad\") " pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684048    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-run-netns\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684070    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-daemon-config\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684119    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfwd8\" (UniqueName: \"kubernetes.io/projected/3390fc0f-4489-4c05-b017-475fdb9c5670-kube-api-access-sfwd8\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684143    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-netns\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684145    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysctl-conf\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684183    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-run\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684218    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3390fc0f-4489-4c05-b017-475fdb9c5670-cni-binary-copy\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-sys\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684255    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-sys\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684258    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684268    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f63cc71d-ab0b-4137-9cce-a1c780acfb09-host\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684261    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysctl-conf\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684289    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-run\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.686390 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684298    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-node-log\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684340    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-run-netns\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684343    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-node-log\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684359    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-system-cni-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-cnibin\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-systemd\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684427    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-var-lib-kubelet\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684447    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-host\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684466    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684482    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/434e8ae7-f2c1-4195-a22e-366bf3290d79-tmp-dir\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684489    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn8t9\" (UniqueName: \"kubernetes.io/projected/368dc546-ddd5-4dfb-8b14-426e6084bd63-kube-api-access-xn8t9\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-etc-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-socket-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684686    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-registration-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684712    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.687149 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684737    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/434e8ae7-f2c1-4195-a22e-366bf3290d79-hosts-file\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.684809    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/434e8ae7-f2c1-4195-a22e-366bf3290d79-hosts-file\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.685090    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-cnibin\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.685139    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-system-cni-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.685182    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-systemd\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.685193    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-daemon-config\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.685197    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.685222    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-var-lib-kubelet\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.685261    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-host\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.685270    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-registration-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:34.685294    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.685359    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:34.685366    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs podName:1a5aacf3-197a-4725-b9ae-a0d0f11888e7 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:35.185346437 +0000 UTC m=+2.294288812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs") pod "network-metrics-daemon-xpf4w" (UID: "1a5aacf3-197a-4725-b9ae-a0d0f11888e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.685366    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-socket-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.685413    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f63cc71d-ab0b-4137-9cce-a1c780acfb09-host\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.685435    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-etc-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:34.685475    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:53:34.687621 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:34.685534    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret podName:5981da65-938a-4058-b3cb-459025feb5d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:35.185516548 +0000 UTC m=+2.294458911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret") pod "global-pull-secret-syncer-2hjmh" (UID: "5981da65-938a-4058-b3cb-459025feb5d6") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:53:34.688104 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.685880    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.688104 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.686023    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.688104 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.686848    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-tuned\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.688104 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.686902    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58eb124c-7ccc-43bf-89d9-72b023b94a27-tmp\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.688104 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.687092    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84f02cd4-68fb-43b2-bb98-86f2fd944aad-agent-certs\") pod \"konnectivity-agent-hjj9v\" (UID: \"84f02cd4-68fb-43b2-bb98-86f2fd944aad\") " pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:53:34.688104 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.687289    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovn-node-metrics-cert\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.743683 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.743649    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhw4h\" (UniqueName: \"kubernetes.io/projected/2feb206d-12b1-4761-96e2-321878073139-kube-api-access-xhw4h\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:53:34.744794 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:34.744769    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:53:34.744899 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:34.744801    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:53:34.744899 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:34.744815    2575 projected.go:196] Error preparing data for projected volume kube-api-access-tk6wz for pod openshift-network-diagnostics/network-check-target-6gnzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:53:34.744899 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.744827    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz52v\" (UniqueName: \"kubernetes.io/projected/28265d99-26ec-4182-a806-4aac326a4781-kube-api-access-hz52v\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.744899 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:34.744887    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz podName:4110027a-d96e-4b82-8206-3f4c30cc5978 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:35.244868932 +0000 UTC m=+2.353811308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tk6wz" (UniqueName: "kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz") pod "network-check-target-6gnzt" (UID: "4110027a-d96e-4b82-8206-3f4c30cc5978") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:53:34.746287 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.746267    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44sns\" (UniqueName: \"kubernetes.io/projected/434e8ae7-f2c1-4195-a22e-366bf3290d79-kube-api-access-44sns\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:53:34.746834 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.746817    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg5j8\" (UniqueName: \"kubernetes.io/projected/4b832e76-992a-4ff5-abe5-44ec22eba0d1-kube-api-access-jg5j8\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:34.747085 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.747069    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4nfk\" (UniqueName: \"kubernetes.io/projected/f63cc71d-ab0b-4137-9cce-a1c780acfb09-kube-api-access-z4nfk\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:53:34.748851 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.748802    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfwd8\" (UniqueName: \"kubernetes.io/projected/3390fc0f-4489-4c05-b017-475fdb9c5670-kube-api-access-sfwd8\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:53:34.749678 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.749660    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l685p\" (UniqueName: \"kubernetes.io/projected/58eb124c-7ccc-43bf-89d9-72b023b94a27-kube-api-access-l685p\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.750881 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.750859    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vktq\" (UniqueName: \"kubernetes.io/projected/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-kube-api-access-8vktq\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:34.752090 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.752071    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn8t9\" (UniqueName: \"kubernetes.io/projected/368dc546-ddd5-4dfb-8b14-426e6084bd63-kube-api-access-xn8t9\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.868239 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.868214    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:53:34.871438 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:34.871404    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13606120155d66241850ec4f52f0e0f4.slice/crio-3c2fe745fe055b7d4992fa9be354e37bd65d79a27fe39dadbd4b30e68d6bd167 WatchSource:0}: Error finding container 3c2fe745fe055b7d4992fa9be354e37bd65d79a27fe39dadbd4b30e68d6bd167: Status 404 returned error can't find the container with id 3c2fe745fe055b7d4992fa9be354e37bd65d79a27fe39dadbd4b30e68d6bd167
Oct 30 21:53:34.871774 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:34.871759    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ec9fc5e2b74da3533af9e11f797bd9.slice/crio-1d3c640addc230d325287ec9275c058fad82f7b59b87cb31e51a51e8fb780bf6 WatchSource:0}: Error finding container 1d3c640addc230d325287ec9275c058fad82f7b59b87cb31e51a51e8fb780bf6: Status 404 returned error can't find the container with id 1d3c640addc230d325287ec9275c058fad82f7b59b87cb31e51a51e8fb780bf6
Oct 30 21:53:34.876020 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:34.875999    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2feb206d_12b1_4761_96e2_321878073139.slice/crio-c521abda0f4a31cd752ab1df32fe777bece4898a2d60d4d9590bb6948974440d WatchSource:0}: Error finding container c521abda0f4a31cd752ab1df32fe777bece4898a2d60d4d9590bb6948974440d: Status 404 returned error can't find the container with id c521abda0f4a31cd752ab1df32fe777bece4898a2d60d4d9590bb6948974440d
Oct 30 21:53:34.877033 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.877011    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:53:34.889653 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.889636    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:53:34.895201 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.895185    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:53:34.896740 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:34.896720    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84f02cd4_68fb_43b2_bb98_86f2fd944aad.slice/crio-31e597c29ce3c5cd37781eb757bcbb836f60c0c35f8175a9de055213830f94c5 WatchSource:0}: Error finding container 31e597c29ce3c5cd37781eb757bcbb836f60c0c35f8175a9de055213830f94c5: Status 404 returned error can't find the container with id 31e597c29ce3c5cd37781eb757bcbb836f60c0c35f8175a9de055213830f94c5
Oct 30 21:53:34.901575 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:34.901557    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58eb124c_7ccc_43bf_89d9_72b023b94a27.slice/crio-f8788597769f3570ea499b5001c4b907a029cc9c6286e799b974b7fcc2f0aedd WatchSource:0}: Error finding container f8788597769f3570ea499b5001c4b907a029cc9c6286e799b974b7fcc2f0aedd: Status 404 returned error can't find the container with id f8788597769f3570ea499b5001c4b907a029cc9c6286e799b974b7fcc2f0aedd
Oct 30 21:53:34.930027 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.930007    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:53:34.936930 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:34.936914    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63cc71d_ab0b_4137_9cce_a1c780acfb09.slice/crio-a91834ecaaf17442c064d2197b65622b3ca40c2c4bf026f474e13a5a09f876d5 WatchSource:0}: Error finding container a91834ecaaf17442c064d2197b65622b3ca40c2c4bf026f474e13a5a09f876d5: Status 404 returned error can't find the container with id a91834ecaaf17442c064d2197b65622b3ca40c2c4bf026f474e13a5a09f876d5
Oct 30 21:53:34.955859 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.955842    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:53:34.961891 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:34.961873    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod368dc546_ddd5_4dfb_8b14_426e6084bd63.slice/crio-a63dd1b4e70a2a0c83c826372a6fed10a172985c42aeea3e83bbbfd80da03edf WatchSource:0}: Error finding container a63dd1b4e70a2a0c83c826372a6fed10a172985c42aeea3e83bbbfd80da03edf: Status 404 returned error can't find the container with id a63dd1b4e70a2a0c83c826372a6fed10a172985c42aeea3e83bbbfd80da03edf
Oct 30 21:53:34.970104 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.970081    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:53:34.977100 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:34.977078    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28265d99_26ec_4182_a806_4aac326a4781.slice/crio-31a2913cd0368886be5d3e71f810e02ad3e68ad8fe848291bf445fa71520caf5 WatchSource:0}: Error finding container 31a2913cd0368886be5d3e71f810e02ad3e68ad8fe848291bf445fa71520caf5: Status 404 returned error can't find the container with id 31a2913cd0368886be5d3e71f810e02ad3e68ad8fe848291bf445fa71520caf5
Oct 30 21:53:34.990304 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:34.990288    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:53:34.997402 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:34.997381    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod434e8ae7_f2c1_4195_a22e_366bf3290d79.slice/crio-3c842eda0020037a73db90bf1983dbdbfb7bd86c94bf1703b54a1aa69bdc9df6 WatchSource:0}: Error finding container 3c842eda0020037a73db90bf1983dbdbfb7bd86c94bf1703b54a1aa69bdc9df6: Status 404 returned error can't find the container with id 3c842eda0020037a73db90bf1983dbdbfb7bd86c94bf1703b54a1aa69bdc9df6
Oct 30 21:53:35.008508 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.008492    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cs98z"
Oct 30 21:53:35.015781 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:35.015763    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3390fc0f_4489_4c05_b017_475fdb9c5670.slice/crio-883fe27eaca3383b6a88a576d027d343f5697e16249acc5f1d4e49f47a6f9d32 WatchSource:0}: Error finding container 883fe27eaca3383b6a88a576d027d343f5697e16249acc5f1d4e49f47a6f9d32: Status 404 returned error can't find the container with id 883fe27eaca3383b6a88a576d027d343f5697e16249acc5f1d4e49f47a6f9d32
Oct 30 21:53:35.019174 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.019158    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:53:35.026030 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:53:35.026011    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b832e76_992a_4ff5_abe5_44ec22eba0d1.slice/crio-936d57274e8af87aeb6f7ab5da7fc1aaea17ec0aa42dc7f2a20fcc36d592983e WatchSource:0}: Error finding container 936d57274e8af87aeb6f7ab5da7fc1aaea17ec0aa42dc7f2a20fcc36d592983e: Status 404 returned error can't find the container with id 936d57274e8af87aeb6f7ab5da7fc1aaea17ec0aa42dc7f2a20fcc36d592983e
Oct 30 21:53:35.028289 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:35.028272    2575 kuberuntime_manager.go:1707] "Unhandled Error" err="container ovn-controller start failed in pod ovnkube-node-nbrqj_openshift-ovn-kubernetes(4b832e76-992a-4ff5-abe5-44ec22eba0d1): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Oct 30 21:53:35.030165 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:35.030145    2575 kuberuntime_manager.go:1707] "Unhandled Error" err="container kube-rbac-proxy-node start failed in pod ovnkube-node-nbrqj_openshift-ovn-kubernetes(4b832e76-992a-4ff5-abe5-44ec22eba0d1): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Oct 30 21:53:35.034573 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:35.034531    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj" podUID="4b832e76-992a-4ff5-abe5-44ec22eba0d1"
Oct 30 21:53:35.152094 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.152067    2575 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:53:35.189483 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.189454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:35.189629 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.189487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:35.189629 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:35.189585    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:53:35.189629 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:35.189607    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:53:35.189766 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:35.189646    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret podName:5981da65-938a-4058-b3cb-459025feb5d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:36.189633239 +0000 UTC m=+3.298575590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret") pod "global-pull-secret-syncer-2hjmh" (UID: "5981da65-938a-4058-b3cb-459025feb5d6") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:53:35.189938 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:35.189910    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs podName:1a5aacf3-197a-4725-b9ae-a0d0f11888e7 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:36.189795213 +0000 UTC m=+3.298737578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs") pod "network-metrics-daemon-xpf4w" (UID: "1a5aacf3-197a-4725-b9ae-a0d0f11888e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:53:35.243048 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.243024    2575 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:53:35.290108 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.290039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk6wz\" (UniqueName: \"kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz\") pod \"network-check-target-6gnzt\" (UID: \"4110027a-d96e-4b82-8206-3f4c30cc5978\") " pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:35.290205 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:35.290171    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:53:35.290205 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:35.290183    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:53:35.290205 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:35.290192    2575 projected.go:196] Error preparing data for projected volume kube-api-access-tk6wz for pod openshift-network-diagnostics/network-check-target-6gnzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:53:35.290314 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:35.290231    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz podName:4110027a-d96e-4b82-8206-3f4c30cc5978 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:36.290220288 +0000 UTC m=+3.399162638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tk6wz" (UniqueName: "kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz") pod "network-check-target-6gnzt" (UID: "4110027a-d96e-4b82-8206-3f4c30cc5978") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:53:35.410195 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.410152    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bvgp5" event={"ID":"434e8ae7-f2c1-4195-a22e-366bf3290d79","Type":"ContainerStarted","Data":"3c842eda0020037a73db90bf1983dbdbfb7bd86c94bf1703b54a1aa69bdc9df6"}
Oct 30 21:53:35.411112 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.411087    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9" event={"ID":"28265d99-26ec-4182-a806-4aac326a4781","Type":"ContainerStarted","Data":"31a2913cd0368886be5d3e71f810e02ad3e68ad8fe848291bf445fa71520caf5"}
Oct 30 21:53:35.412022 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.412001    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4222" event={"ID":"368dc546-ddd5-4dfb-8b14-426e6084bd63","Type":"ContainerStarted","Data":"a63dd1b4e70a2a0c83c826372a6fed10a172985c42aeea3e83bbbfd80da03edf"}
Oct 30 21:53:35.413015 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.412997    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hjj9v" event={"ID":"84f02cd4-68fb-43b2-bb98-86f2fd944aad","Type":"ContainerStarted","Data":"31e597c29ce3c5cd37781eb757bcbb836f60c0c35f8175a9de055213830f94c5"}
Oct 30 21:53:35.413965 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.413947    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal" event={"ID":"45ec9fc5e2b74da3533af9e11f797bd9","Type":"ContainerStarted","Data":"1d3c640addc230d325287ec9275c058fad82f7b59b87cb31e51a51e8fb780bf6"}
Oct 30 21:53:35.414917 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.414893    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cs98z" event={"ID":"3390fc0f-4489-4c05-b017-475fdb9c5670","Type":"ContainerStarted","Data":"883fe27eaca3383b6a88a576d027d343f5697e16249acc5f1d4e49f47a6f9d32"}
Oct 30 21:53:35.415777 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.415759    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p97r6" event={"ID":"f63cc71d-ab0b-4137-9cce-a1c780acfb09","Type":"ContainerStarted","Data":"a91834ecaaf17442c064d2197b65622b3ca40c2c4bf026f474e13a5a09f876d5"}
Oct 30 21:53:35.416622 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.416603    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kw6b8" event={"ID":"58eb124c-7ccc-43bf-89d9-72b023b94a27","Type":"ContainerStarted","Data":"f8788597769f3570ea499b5001c4b907a029cc9c6286e799b974b7fcc2f0aedd"}
Oct 30 21:53:35.417539 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.417518    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9wkj7" event={"ID":"2feb206d-12b1-4761-96e2-321878073139","Type":"ContainerStarted","Data":"c521abda0f4a31cd752ab1df32fe777bece4898a2d60d4d9590bb6948974440d"}
Oct 30 21:53:35.418463 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.418447    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal" event={"ID":"13606120155d66241850ec4f52f0e0f4","Type":"ContainerStarted","Data":"3c2fe745fe055b7d4992fa9be354e37bd65d79a27fe39dadbd4b30e68d6bd167"}
Oct 30 21:53:35.419438 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.419421    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj" event={"ID":"4b832e76-992a-4ff5-abe5-44ec22eba0d1","Type":"ContainerStarted","Data":"936d57274e8af87aeb6f7ab5da7fc1aaea17ec0aa42dc7f2a20fcc36d592983e"}
Oct 30 21:53:35.428374 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.428352    2575 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:53:35.429554 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:35.429514    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d017b7d199b1d54e889bb1eb6e572d8e6d94ad92610894009ee0562c2a5c0f51\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be9d8303ae4f79715ade971ddecdf6044ee6bb7b8d8b3a2f2f1e3bfe4e78c15a\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj" podUID="4b832e76-992a-4ff5-abe5-44ec22eba0d1"
Oct 30 21:53:35.643375 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.643277    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:48:34 +0000 UTC" deadline="2028-04-28 05:57:32.560244896 +0000 UTC"
Oct 30 21:53:35.643375 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:35.643316    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13088h3m56.916932465s"
Oct 30 21:53:36.197438 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:36.197397    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:36.197658 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:36.197445    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:36.197658 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:36.197568    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:53:36.197658 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:36.197640    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs podName:1a5aacf3-197a-4725-b9ae-a0d0f11888e7 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:38.197623394 +0000 UTC m=+5.306565759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs") pod "network-metrics-daemon-xpf4w" (UID: "1a5aacf3-197a-4725-b9ae-a0d0f11888e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:53:36.197971 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:36.197948    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:53:36.198037 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:36.198003    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret podName:5981da65-938a-4058-b3cb-459025feb5d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:38.197989163 +0000 UTC m=+5.306931527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret") pod "global-pull-secret-syncer-2hjmh" (UID: "5981da65-938a-4058-b3cb-459025feb5d6") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:53:36.298394 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:36.298355    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk6wz\" (UniqueName: \"kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz\") pod \"network-check-target-6gnzt\" (UID: \"4110027a-d96e-4b82-8206-3f4c30cc5978\") " pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:36.298918 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:36.298542    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:53:36.298918 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:36.298567    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:53:36.298918 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:36.298579    2575 projected.go:196] Error preparing data for projected volume kube-api-access-tk6wz for pod openshift-network-diagnostics/network-check-target-6gnzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:53:36.298918 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:36.298653    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz podName:4110027a-d96e-4b82-8206-3f4c30cc5978 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:38.298635301 +0000 UTC m=+5.407577653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tk6wz" (UniqueName: "kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz") pod "network-check-target-6gnzt" (UID: "4110027a-d96e-4b82-8206-3f4c30cc5978") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:53:36.410040 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:36.409873    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:36.410040 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:36.409992    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:36.410040 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:36.409997    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:53:36.410040 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:36.410038    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:36.410510 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:36.410114    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:53:36.410510 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:36.410191    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:53:36.643514 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:36.643395    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:48:34 +0000 UTC" deadline="2028-05-17 23:03:16.00739757 +0000 UTC"
Oct 30 21:53:36.643514 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:36.643457    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13561h9m39.363944275s"
Oct 30 21:53:38.215826 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:38.215747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:38.215826 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:38.215799    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:38.216342 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:38.215944    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:53:38.216342 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:38.215989    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs podName:1a5aacf3-197a-4725-b9ae-a0d0f11888e7 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:42.21597678 +0000 UTC m=+9.324919145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs") pod "network-metrics-daemon-xpf4w" (UID: "1a5aacf3-197a-4725-b9ae-a0d0f11888e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:53:38.216342 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:38.216038    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:53:38.216342 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:38.216061    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret podName:5981da65-938a-4058-b3cb-459025feb5d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:42.216054834 +0000 UTC m=+9.324997198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret") pod "global-pull-secret-syncer-2hjmh" (UID: "5981da65-938a-4058-b3cb-459025feb5d6") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:53:38.316984 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:38.316929    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk6wz\" (UniqueName: \"kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz\") pod \"network-check-target-6gnzt\" (UID: \"4110027a-d96e-4b82-8206-3f4c30cc5978\") " pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:38.317223 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:38.317120    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:53:38.317223 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:38.317147    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:53:38.317223 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:38.317159    2575 projected.go:196] Error preparing data for projected volume kube-api-access-tk6wz for pod openshift-network-diagnostics/network-check-target-6gnzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:53:38.317223 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:38.317216    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz podName:4110027a-d96e-4b82-8206-3f4c30cc5978 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:42.317196802 +0000 UTC m=+9.426139152 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tk6wz" (UniqueName: "kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz") pod "network-check-target-6gnzt" (UID: "4110027a-d96e-4b82-8206-3f4c30cc5978") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:53:38.407227 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:38.407187    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:38.407375 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:38.407324    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:53:38.407452 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:38.407397    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:38.407504 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:38.407485    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:53:38.407581 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:38.407528    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:38.407653 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:38.407607    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:53:39.447608 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:39.443712    2575 generic.go:356] "Generic (PLEG): container finished" podID="368dc546-ddd5-4dfb-8b14-426e6084bd63" containerID="1440af7cf1deceb7fe8fe45a80e12e936cbf2cd2872a30bb7d4bb45a3a76a7ae" exitCode=0
Oct 30 21:53:39.447608 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:39.444023    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4222" event={"ID":"368dc546-ddd5-4dfb-8b14-426e6084bd63","Type":"ContainerDied","Data":"1440af7cf1deceb7fe8fe45a80e12e936cbf2cd2872a30bb7d4bb45a3a76a7ae"}
Oct 30 21:53:39.453355 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:39.453274    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hjj9v" event={"ID":"84f02cd4-68fb-43b2-bb98-86f2fd944aad","Type":"ContainerStarted","Data":"aac133e90966f0ba60781dbba79b0daa54e81e96b9fdb127a2a07c8f68d20b90"}
Oct 30 21:53:39.458766 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:39.458737    2575 generic.go:356] "Generic (PLEG): container finished" podID="45ec9fc5e2b74da3533af9e11f797bd9" containerID="2aed4abfb9fb57ca1fdb71e33ac3b3d636733bf961476b559f643e5d60d9de84" exitCode=0
Oct 30 21:53:39.458880 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:39.458779    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal" event={"ID":"45ec9fc5e2b74da3533af9e11f797bd9","Type":"ContainerDied","Data":"2aed4abfb9fb57ca1fdb71e33ac3b3d636733bf961476b559f643e5d60d9de84"}
Oct 30 21:53:39.684780 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:39.684717    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hjj9v" podStartSLOduration=2.45981727 podStartE2EDuration="6.684704425s" totalImagesPullingTime="4.224887155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:39.68468699 +0000 UTC m=+6.793629365" watchObservedRunningTime="2026-10-30 21:53:39.684704425 +0000 UTC m=+6.793646797"
Oct 30 21:53:39.997519 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:39.997450    2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:53:39.998182 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:39.998160    2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:53:40.406687 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:40.406659    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:40.406881 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:40.406783    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:53:40.406881 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:40.406854    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:40.406999 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:40.406937    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:53:40.406999 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:40.406987    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:40.407076 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:40.407058    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:53:40.464056 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:40.464023    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal" event={"ID":"45ec9fc5e2b74da3533af9e11f797bd9","Type":"ContainerStarted","Data":"426087bf5f3991bb8ca922f8aa536818f97e33507bbcf8bd0ac72679929247f6"}
Oct 30 21:53:40.466978 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:40.466953    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p97r6" event={"ID":"f63cc71d-ab0b-4137-9cce-a1c780acfb09","Type":"ContainerStarted","Data":"eb1bedf4b04c19ef9b43126fc9568e11702a546d832cf9af6d89f42bbd6d7536"}
Oct 30 21:53:40.469972 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:40.469950    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal" event={"ID":"13606120155d66241850ec4f52f0e0f4","Type":"ContainerStarted","Data":"133d82feb8c5c77efce6a662ec3a16f42b043d45b5153f3de8c336b171b17e78"}
Oct 30 21:53:40.698973 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:40.698927    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal" podStartSLOduration=7.698913071 podStartE2EDuration="7.698913071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:40.6983927 +0000 UTC m=+7.807335073" watchObservedRunningTime="2026-10-30 21:53:40.698913071 +0000 UTC m=+7.807855444"
Oct 30 21:53:40.699081 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:40.698999    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal" podStartSLOduration=7.698993868 podStartE2EDuration="7.698993868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:40.58388635 +0000 UTC m=+7.692828722" watchObservedRunningTime="2026-10-30 21:53:40.698993868 +0000 UTC m=+7.807936242"
Oct 30 21:53:41.474790 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:41.474756    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9" event={"ID":"28265d99-26ec-4182-a806-4aac326a4781","Type":"ContainerStarted","Data":"f7c86de3114398fe2324a15f1c8b4bc0a151424e58964fd547eb5f5118b05a17"}
Oct 30 21:53:41.475259 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:41.474851    2575 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:53:42.247188 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:42.247157    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:42.247307 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:42.247206    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:42.247379 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:42.247359    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:53:42.247437 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:42.247416    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs podName:1a5aacf3-197a-4725-b9ae-a0d0f11888e7 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:50.247399475 +0000 UTC m=+17.356341844 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs") pod "network-metrics-daemon-xpf4w" (UID: "1a5aacf3-197a-4725-b9ae-a0d0f11888e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:53:42.247636 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:42.247613    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:53:42.247761 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:42.247679    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret podName:5981da65-938a-4058-b3cb-459025feb5d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:50.247662357 +0000 UTC m=+17.356604712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret") pod "global-pull-secret-syncer-2hjmh" (UID: "5981da65-938a-4058-b3cb-459025feb5d6") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:53:42.348421 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:42.348364    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk6wz\" (UniqueName: \"kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz\") pod \"network-check-target-6gnzt\" (UID: \"4110027a-d96e-4b82-8206-3f4c30cc5978\") " pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:42.348561 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:42.348540    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:53:42.349155 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:42.348561    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:53:42.349155 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:42.348573    2575 projected.go:196] Error preparing data for projected volume kube-api-access-tk6wz for pod openshift-network-diagnostics/network-check-target-6gnzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:53:42.349155 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:42.348644    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz podName:4110027a-d96e-4b82-8206-3f4c30cc5978 nodeName:}" failed. No retries permitted until 2026-10-30 21:53:50.348625562 +0000 UTC m=+17.457567932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tk6wz" (UniqueName: "kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz") pod "network-check-target-6gnzt" (UID: "4110027a-d96e-4b82-8206-3f4c30cc5978") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:53:42.400444 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:42.400170    2575 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 21:53:42.406655 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:42.406627    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:42.406788 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:42.406740    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:42.406788 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:42.406749    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:53:42.406788 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:42.406779    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:42.406957 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:42.406849    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:53:42.406957 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:42.406932    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:53:42.478863 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:42.478789    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bvgp5" event={"ID":"434e8ae7-f2c1-4195-a22e-366bf3290d79","Type":"ContainerStarted","Data":"a162de0cd128c282a3b188fc0e5d4074584d7bab3cf9f2a8225315dbd75f65b6"}
Oct 30 21:53:42.481056 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:42.481027    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9" event={"ID":"28265d99-26ec-4182-a806-4aac326a4781","Type":"ContainerStarted","Data":"f07d962677edcf34c7981890cf5b0cd2a026737054eb57dac1dd676fafaad567"}
Oct 30 21:53:42.482951 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:42.482540    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cs98z" event={"ID":"3390fc0f-4489-4c05-b017-475fdb9c5670","Type":"ContainerStarted","Data":"082123127caf08678682af1049d6f8be140f80d3ed800055ad8fcc32d09c16c5"}
Oct 30 21:53:42.594867 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:42.594821    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p97r6" podStartSLOduration=4.625819939 podStartE2EDuration="9.594804085s" totalImagesPullingTime="4.968984146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:40.814659013 +0000 UTC m=+7.923601387" watchObservedRunningTime="2026-10-30 21:53:42.594804085 +0000 UTC m=+9.703746461"
Oct 30 21:53:42.595162 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:42.595128    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-bvgp5" podStartSLOduration=2.3282121829999998 podStartE2EDuration="9.595117317s" totalImagesPullingTime="7.266905134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:42.594570316 +0000 UTC m=+9.703512690" watchObservedRunningTime="2026-10-30 21:53:42.595117317 +0000 UTC m=+9.704059689"
Oct 30 21:53:42.713859 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:42.713813    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-cs98z" podStartSLOduration=2.814211305 podStartE2EDuration="9.713797007s" totalImagesPullingTime="6.899585702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:42.713467516 +0000 UTC m=+9.822409890" watchObservedRunningTime="2026-10-30 21:53:42.713797007 +0000 UTC m=+9.822739380"
Oct 30 21:53:43.329396 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:43.329244    2575 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:53:42.400190343Z","UUID":"1841e4ad-4826-403c-84dc-35a31c9c21d8","Handler":null,"Name":"","Endpoint":""}
Oct 30 21:53:43.335774 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:43.335745    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 21:53:43.335917 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:43.335782    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 21:53:43.487462 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:43.487234    2575 generic.go:356] "Generic (PLEG): container finished" podID="368dc546-ddd5-4dfb-8b14-426e6084bd63" containerID="f547d54dfa3ec3ca5fd7940976b2a4b82067c469d70f4089be4e80df12f39651" exitCode=0
Oct 30 21:53:43.488666 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:43.488637    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4222" event={"ID":"368dc546-ddd5-4dfb-8b14-426e6084bd63","Type":"ContainerDied","Data":"f547d54dfa3ec3ca5fd7940976b2a4b82067c469d70f4089be4e80df12f39651"}
Oct 30 21:53:44.406577 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:44.406546    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:44.406751 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:44.406622    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:44.406751 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:44.406649    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:44.406870 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:44.406747    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:53:44.406870 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:44.406821    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:53:44.406961 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:44.406884    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:53:44.490389 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:44.490356    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kw6b8" event={"ID":"58eb124c-7ccc-43bf-89d9-72b023b94a27","Type":"ContainerStarted","Data":"885a5e07f699acddaf3d971b965acc05671b520c7cf7228da0bd5aa804983db3"}
Oct 30 21:53:44.491558 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:44.491535    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9wkj7" event={"ID":"2feb206d-12b1-4761-96e2-321878073139","Type":"ContainerStarted","Data":"74ff43c29a1830a9e5a057fa995829111054a50c4958d298d4013d979e521e04"}
Oct 30 21:53:44.493368 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:44.493348    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9" event={"ID":"28265d99-26ec-4182-a806-4aac326a4781","Type":"ContainerStarted","Data":"29ac23e841f53462f882bf3f2ce2a8e438477ac709c4564a5dc26eb404789ff1"}
Oct 30 21:53:44.609426 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:44.609381    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kw6b8" podStartSLOduration=2.692575653 podStartE2EDuration="11.609368728s" totalImagesPullingTime="8.916793075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:44.609143279 +0000 UTC m=+11.718085654" watchObservedRunningTime="2026-10-30 21:53:44.609368728 +0000 UTC m=+11.718311100"
Oct 30 21:53:44.735834 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:44.735764    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9wkj7" podStartSLOduration=4.480011611 podStartE2EDuration="11.735750414s" totalImagesPullingTime="7.255738803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:44.735286707 +0000 UTC m=+11.844229077" watchObservedRunningTime="2026-10-30 21:53:44.735750414 +0000 UTC m=+11.844692787"
Oct 30 21:53:44.854681 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:44.854630    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9" podStartSLOduration=3.443119027 podStartE2EDuration="11.854618769s" totalImagesPullingTime="8.411499742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:44.854224183 +0000 UTC m=+11.963166557" watchObservedRunningTime="2026-10-30 21:53:44.854618769 +0000 UTC m=+11.963561142"
Oct 30 21:53:45.497212 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:45.497184    2575 generic.go:356] "Generic (PLEG): container finished" podID="368dc546-ddd5-4dfb-8b14-426e6084bd63" containerID="ff0c40bc93fc4d672420268e6d7e028a2fd6c22de732b0e1540dae60d77fae4f" exitCode=0
Oct 30 21:53:45.497790 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:45.497287    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4222" event={"ID":"368dc546-ddd5-4dfb-8b14-426e6084bd63","Type":"ContainerDied","Data":"ff0c40bc93fc4d672420268e6d7e028a2fd6c22de732b0e1540dae60d77fae4f"}
Oct 30 21:53:46.406990 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:46.406952    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:46.406990 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:46.406979    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:46.407193 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:46.407093    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:46.407193 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:46.407102    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:53:46.407193 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:46.407161    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:53:46.407346 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:46.407226    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:53:47.503298 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:47.503125    2575 generic.go:356] "Generic (PLEG): container finished" podID="368dc546-ddd5-4dfb-8b14-426e6084bd63" containerID="98e68aa075af7cd29c78649445f6dd1a058a98777739c2a0d736de2cb60ac2fa" exitCode=0
Oct 30 21:53:47.503298 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:47.503203    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4222" event={"ID":"368dc546-ddd5-4dfb-8b14-426e6084bd63","Type":"ContainerDied","Data":"98e68aa075af7cd29c78649445f6dd1a058a98777739c2a0d736de2cb60ac2fa"}
Oct 30 21:53:48.406735 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:48.406704    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:48.406939 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:48.406829    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:48.406939 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:48.406842    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:53:48.406939 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:48.406909    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:48.406939 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:48.406914    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:53:48.407137 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:48.406981    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:53:50.302034 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:50.301969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:50.302034 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:50.302004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:50.302415 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:50.302106    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:53:50.302415 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:50.302106    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:53:50.302415 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:50.302155    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs podName:1a5aacf3-197a-4725-b9ae-a0d0f11888e7 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:06.302138388 +0000 UTC m=+33.411080757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs") pod "network-metrics-daemon-xpf4w" (UID: "1a5aacf3-197a-4725-b9ae-a0d0f11888e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:53:50.302415 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:50.302168    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret podName:5981da65-938a-4058-b3cb-459025feb5d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:06.302162206 +0000 UTC m=+33.411104557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret") pod "global-pull-secret-syncer-2hjmh" (UID: "5981da65-938a-4058-b3cb-459025feb5d6") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:53:50.402806 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:50.402775    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk6wz\" (UniqueName: \"kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz\") pod \"network-check-target-6gnzt\" (UID: \"4110027a-d96e-4b82-8206-3f4c30cc5978\") " pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:50.402988 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:50.402881    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:53:50.402988 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:50.402897    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:53:50.402988 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:50.402908    2575 projected.go:196] Error preparing data for projected volume kube-api-access-tk6wz for pod openshift-network-diagnostics/network-check-target-6gnzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:53:50.402988 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:50.402948    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz podName:4110027a-d96e-4b82-8206-3f4c30cc5978 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:06.402936756 +0000 UTC m=+33.511879120 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tk6wz" (UniqueName: "kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz") pod "network-check-target-6gnzt" (UID: "4110027a-d96e-4b82-8206-3f4c30cc5978") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:53:50.406933 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:50.406916    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:50.407011 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:50.406999    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:50.407044 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:50.407003    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:53:50.407093 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:50.407078    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:53:50.407130 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:50.407096    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:50.407253 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:50.407238    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:53:50.511085 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:50.511065    2575 generic.go:356] "Generic (PLEG): container finished" podID="368dc546-ddd5-4dfb-8b14-426e6084bd63" containerID="b79b89c7a3ef73b58add650de242aaeddc0580a9f34b9bc9b6418022cd03126a" exitCode=0
Oct 30 21:53:50.511206 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:50.511103    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4222" event={"ID":"368dc546-ddd5-4dfb-8b14-426e6084bd63","Type":"ContainerDied","Data":"b79b89c7a3ef73b58add650de242aaeddc0580a9f34b9bc9b6418022cd03126a"}
Oct 30 21:53:51.517482 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:51.517386    2575 generic.go:356] "Generic (PLEG): container finished" podID="368dc546-ddd5-4dfb-8b14-426e6084bd63" containerID="526269cc09559e63923eabb2fbed40549717d979aec84a4a706adc5c0390464e" exitCode=0
Oct 30 21:53:51.517482 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:51.517433    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4222" event={"ID":"368dc546-ddd5-4dfb-8b14-426e6084bd63","Type":"ContainerDied","Data":"526269cc09559e63923eabb2fbed40549717d979aec84a4a706adc5c0390464e"}
Oct 30 21:53:52.407351 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:52.407317    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:52.407524 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:52.407438    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:53:52.407824 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:52.407803    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:52.407944 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:52.407911    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:53:52.408008 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:52.407974    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:52.408062 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:52.408043    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:53:52.523677 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:52.523640    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4222" event={"ID":"368dc546-ddd5-4dfb-8b14-426e6084bd63","Type":"ContainerStarted","Data":"fbf49388aeea8eb1c699ab48cb9645366482e5a30c0c6f74a93f20eaccf307ea"}
Oct 30 21:53:54.406439 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:54.406400    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:54.406994 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:54.406443    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:54.406994 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:54.406512    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:53:54.406994 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:54.406671    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:53:54.406994 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:54.406712    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:54.406994 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:54.406784    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:53:56.406930 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:56.406899    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:56.407377 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:56.406937    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:56.407377 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:56.407009    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:56.407377 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:56.407027    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:53:56.407377 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:56.407095    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:53:56.407377 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:56.407159    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:53:58.406736 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:58.406705    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:53:58.407274 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:58.406705    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:53:58.407274 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:58.406840    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:53:58.407274 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:53:58.406705    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:53:58.407274 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:58.406870    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:53:58.407274 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:53:58.406950    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:54:00.407332 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:00.407292    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:00.407332 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:00.407329    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:00.407802 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:00.407309    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:00.407802 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:00.407425    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:54:00.407802 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:00.407512    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:54:00.407802 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:00.407624    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:54:01.350960 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:01.350721    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:54:01.351109 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:01.351010    2575 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:54:01.351269 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:01.351252    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:54:01.469838 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:01.469793    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z4222" podStartSLOduration=17.463270538 podStartE2EDuration="28.469780775s" totalImagesPullingTime="11.006510237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:52.750474654 +0000 UTC m=+19.859417024" watchObservedRunningTime="2026-10-30 21:54:01.469780775 +0000 UTC m=+28.578723148"
Oct 30 21:54:01.544703 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:01.544675    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj" event={"ID":"4b832e76-992a-4ff5-abe5-44ec22eba0d1","Type":"ContainerStarted","Data":"36cc67361ec6ab9973ed157ab0ff041beb0c4f2b1c5fc3817e2eb819a72ba9d3"}
Oct 30 21:54:01.544844 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:01.544735    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj" event={"ID":"4b832e76-992a-4ff5-abe5-44ec22eba0d1","Type":"ContainerStarted","Data":"d5235c33180757777a2b051ce1399e70f1771f5cbba4a0aea22c8b27500fd13c"}
Oct 30 21:54:01.544844 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:01.544766    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj" event={"ID":"4b832e76-992a-4ff5-abe5-44ec22eba0d1","Type":"ContainerStarted","Data":"5d22b976de372dd0e3645e12a275d9871013cd54faa72aefe4f715fdbde81aba"}
Oct 30 21:54:01.544844 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:01.544797    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj" event={"ID":"4b832e76-992a-4ff5-abe5-44ec22eba0d1","Type":"ContainerStarted","Data":"5e44a152d9856987574237b5322c84112f86efe47b056685bdb7c89a11fa205c"}
Oct 30 21:54:01.544844 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:01.544824    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj" event={"ID":"4b832e76-992a-4ff5-abe5-44ec22eba0d1","Type":"ContainerStarted","Data":"02695d59dab5a20fb1e81e9ccc5ec7fa1d14075f1f9bbc425d7eb98804396c4b"}
Oct 30 21:54:01.545040 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:01.544850    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj" event={"ID":"4b832e76-992a-4ff5-abe5-44ec22eba0d1","Type":"ContainerStarted","Data":"b33109391bd0a135dab0ddb2a7255d68011a135f08541c114cd99a96282bc8b5"}
Oct 30 21:54:02.406911 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:02.406826    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:02.407072 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:02.406940    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:02.407072 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:02.406951    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:54:02.407072 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:02.406969    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:02.407072 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:02.407047    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:54:02.407261 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:02.407109    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:54:03.550987 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:03.550906    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj" event={"ID":"4b832e76-992a-4ff5-abe5-44ec22eba0d1","Type":"ContainerStarted","Data":"5fcf0d7b91074ab91bd6280b5e4458afc102b67f2d162bf4b0e4d87d7a92fd17"}
Oct 30 21:54:04.406346 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:04.406313    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:04.406524 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:04.406314    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:04.406524 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:04.406313    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:04.406524 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:04.406509    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:54:04.406674 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:04.406545    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:54:04.406674 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:04.406404    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:54:05.558474 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:05.558366    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj" event={"ID":"4b832e76-992a-4ff5-abe5-44ec22eba0d1","Type":"ContainerStarted","Data":"b2567159267d076f50b3459cf223c7273bf61d7dce1edb61038f66d74c1f3722"}
Oct 30 21:54:05.559041 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:05.558625    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:05.559041 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:05.558685    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:05.573532 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:05.573508    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:05.849312 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:05.849230    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj" podStartSLOduration=6.969102459 podStartE2EDuration="32.84921739s" totalImagesPullingTime="25.880114931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:53:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:05.800024088 +0000 UTC m=+32.908966461" watchObservedRunningTime="2026-10-30 21:54:05.84921739 +0000 UTC m=+32.958159765"
Oct 30 21:54:06.310503 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:06.310431    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:06.310503 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:06.310462    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:06.310761 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:06.310549    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:54:06.310761 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:06.310558    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:54:06.310761 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:06.310614    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs podName:1a5aacf3-197a-4725-b9ae-a0d0f11888e7 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:38.31058191 +0000 UTC m=+65.419524276 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs") pod "network-metrics-daemon-xpf4w" (UID: "1a5aacf3-197a-4725-b9ae-a0d0f11888e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:54:06.310761 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:06.310631    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret podName:5981da65-938a-4058-b3cb-459025feb5d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:38.310622722 +0000 UTC m=+65.419565075 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret") pod "global-pull-secret-syncer-2hjmh" (UID: "5981da65-938a-4058-b3cb-459025feb5d6") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:54:06.406900 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:06.406875    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:06.407007 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:06.406906    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:06.407007 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:06.406964    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:54:06.407069 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:06.407006    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:06.407100 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:06.407076    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:54:06.407144 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:06.407128    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:54:06.410996 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:06.410981    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk6wz\" (UniqueName: \"kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz\") pod \"network-check-target-6gnzt\" (UID: \"4110027a-d96e-4b82-8206-3f4c30cc5978\") " pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:06.411107 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:06.411096    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:54:06.411142 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:06.411110    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:54:06.411142 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:06.411118    2575 projected.go:196] Error preparing data for projected volume kube-api-access-tk6wz for pod openshift-network-diagnostics/network-check-target-6gnzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:54:06.411201 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:06.411152    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz podName:4110027a-d96e-4b82-8206-3f4c30cc5978 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:38.411141338 +0000 UTC m=+65.520083690 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tk6wz" (UniqueName: "kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz") pod "network-check-target-6gnzt" (UID: "4110027a-d96e-4b82-8206-3f4c30cc5978") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:54:06.561162 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:06.561089    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:06.576056 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:06.576034    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:08.195437 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:08.195406    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2hjmh"]
Oct 30 21:54:08.195906 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:08.195558    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:08.195906 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:08.195681    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:54:08.196572 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:08.196541    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6gnzt"]
Oct 30 21:54:08.196701 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:08.196684    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:08.196798 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:08.196779    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:54:08.198913 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:08.198891    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xpf4w"]
Oct 30 21:54:08.199016 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:08.198984    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:08.199070 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:08.199056    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:54:09.407434 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:09.407404    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:09.407763 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:09.407534    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:54:09.407763 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:09.407580    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:09.407763 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:09.407685    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:54:10.406384 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:10.406345    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:10.406532 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:10.406462    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:54:11.407227 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:11.407197    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:11.407619 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:11.407296    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:54:11.407619 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:11.407347    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:11.407619 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:11.407432    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:54:12.406585 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:12.406556    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:12.406790 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:12.406696    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpf4w" podUID="1a5aacf3-197a-4725-b9ae-a0d0f11888e7"
Oct 30 21:54:13.407924 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.407773    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:13.408240 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:13.407980    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjmh" podUID="5981da65-938a-4058-b3cb-459025feb5d6"
Oct 30 21:54:13.408240 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.407856    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:13.408240 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:13.408100    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6gnzt" podUID="4110027a-d96e-4b82-8206-3f4c30cc5978"
Oct 30 21:54:13.667966 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.667944    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeReady"
Oct 30 21:54:13.668081 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.668070    2575 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 21:54:13.824488 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.824420    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-d9h59"]
Oct 30 21:54:13.826476 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.826456    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bhpxt"]
Oct 30 21:54:13.826598 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.826570    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-d9h59"
Oct 30 21:54:13.827963 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.827945    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-x9kk6"]
Oct 30 21:54:13.828081 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.828066    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-bhpxt"
Oct 30 21:54:13.829404 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.829389    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-x9kk6"
Oct 30 21:54:13.833624 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.833608    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-dglp8"]
Oct 30 21:54:13.836399 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.836382    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b9c975d75-kkjl6"]
Oct 30 21:54:13.836490 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.836477    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:13.837721 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.837706    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5c6c4f6cbf-rnprt"]
Oct 30 21:54:13.837839 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.837823    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:13.839174 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.839156    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"]
Oct 30 21:54:13.839257 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.839244    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:13.840841 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.840825    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"]
Oct 30 21:54:13.840934 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.840920    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:13.842452 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.842435    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wlt6w"]
Oct 30 21:54:13.842635 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.842556    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:13.844055 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.844039    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wlt6w"
Oct 30 21:54:13.871273 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.871253    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-57lx9"]
Oct 30 21:54:13.872789 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.872761    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-bj87t"]
Oct 30 21:54:13.872967 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.872847    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:13.874270 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.874253    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"]
Oct 30 21:54:13.874369 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.874353    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:13.875795 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.875779    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cc778465d-n66s7"]
Oct 30 21:54:13.875900 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.875885    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:13.877454 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.877437    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:13.882753 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.882733    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 21:54:13.883042 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.883027    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 21:54:13.883123 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.883059    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"]
Oct 30 21:54:13.885199 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.885170    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-rdsd9"]
Oct 30 21:54:13.885295 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.885274    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:13.893459 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.888582    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 21:54:13.894789 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.894772    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tr6dv"]
Oct 30 21:54:13.895271 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.895247    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rdsd9"
Oct 30 21:54:13.896235 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.896219    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rbmtp"]
Oct 30 21:54:13.896358 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.896340    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tr6dv"
Oct 30 21:54:13.897781 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.897764    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-d9h59"]
Oct 30 21:54:13.897866 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.897794    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bhpxt"]
Oct 30 21:54:13.897866 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.897814    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-x9kk6"]
Oct 30 21:54:13.897866 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.897833    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-dglp8"]
Oct 30 21:54:13.897982 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.897895    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:13.911648 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.911628    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"]
Oct 30 21:54:13.917375 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.917354    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-57lx9"]
Oct 30 21:54:13.917485 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.917397    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"]
Oct 30 21:54:13.918446 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.918429    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b9c975d75-kkjl6"]
Oct 30 21:54:13.921370 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.921352    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wlt6w"]
Oct 30 21:54:13.922339 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.922317    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"]
Oct 30 21:54:13.923792 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.923774    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 21:54:13.923964 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.923796    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 21:54:13.923964 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.923797    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 21:54:13.924075 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.923991    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 21:54:13.924075 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.923809    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 21:54:13.924075 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.924014    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bmck6\""
Oct 30 21:54:13.924075 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.924063    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jwqz7\""
Oct 30 21:54:13.928037 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.928020    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 21:54:13.928871 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.928855    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 21:54:13.928977 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.928962    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wz9hq\""
Oct 30 21:54:13.931789 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.931766    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vlbqj\""
Oct 30 21:54:13.931869 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.931794    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 21:54:13.931869 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.931800    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2wsf2\""
Oct 30 21:54:13.931954 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.931879    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-26qpw\""
Oct 30 21:54:13.932006 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.931984    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 21:54:13.932006 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.931992    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 21:54:13.932101 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.932020    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-njrjg\""
Oct 30 21:54:13.932101 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.932065    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rqktt\""
Oct 30 21:54:13.932101 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.932070    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 21:54:13.932247 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.932159    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 21:54:13.932247 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.932193    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-474dq\""
Oct 30 21:54:13.937615 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.937571    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 21:54:13.938013 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.937998    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mkcm6\""
Oct 30 21:54:13.951584 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.951566    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tr6dv"]
Oct 30 21:54:13.957406 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.957383    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rbmtp"]
Oct 30 21:54:13.957547 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.957441    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"]
Oct 30 21:54:13.958418 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.958400    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-rdsd9"]
Oct 30 21:54:13.965415 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.965395    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c6c4f6cbf-rnprt"]
Oct 30 21:54:13.975969 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.975949    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftbtr\" (UniqueName: \"kubernetes.io/projected/b7d2b389-602c-4ef9-a4eb-2caf80e330d0-kube-api-access-ftbtr\") pod \"kas-connection-checker-685895c7c9-x9kk6\" (UID: \"b7d2b389-602c-4ef9-a4eb-2caf80e330d0\") " pod="kube-system/kas-connection-checker-685895c7c9-x9kk6"
Oct 30 21:54:13.976061 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.975976    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:13.976061 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.975993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74zs2\" (UniqueName: \"kubernetes.io/projected/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-kube-api-access-74zs2\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:13.976061 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d85ad48-ac81-4f99-83d9-9e93db301d40-trusted-ca\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:13.976061 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:13.976190 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976069    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60427449-1081-4049-a2e8-3665f4dbdd63-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:13.976190 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976111    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhng5\" (UniqueName: \"kubernetes.io/projected/598df9f3-580f-4014-9abd-a9d84272f7d7-kube-api-access-qhng5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:13.976190 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976152    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb6hh\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-kube-api-access-zb6hh\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:13.976309 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976205    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60427449-1081-4049-a2e8-3665f4dbdd63-tmp\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:13.976309 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976225    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:13.976309 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976281    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmdfr\" (UniqueName: \"kubernetes.io/projected/9d85ad48-ac81-4f99-83d9-9e93db301d40-kube-api-access-tmdfr\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:13.976413 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-stats-auth\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:13.976413 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976406    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:13.976486 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:13.976486 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kjq8\" (UniqueName: \"kubernetes.io/projected/1f4fae7b-7758-422b-9271-451c4904c76e-kube-api-access-6kjq8\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:13.976486 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976458    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d85ad48-ac81-4f99-83d9-9e93db301d40-config\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:13.976486 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5mdx\" (UniqueName: \"kubernetes.io/projected/318576c4-97c5-473c-9ea5-4a61c104f89f-kube-api-access-h5mdx\") pod \"network-check-source-6f78d59f99-rdsd9\" (UID: \"318576c4-97c5-473c-9ea5-4a61c104f89f\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rdsd9"
Oct 30 21:54:13.976640 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976510    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-config-volume\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:13.976640 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-certificates\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:13.976640 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/598df9f3-580f-4014-9abd-a9d84272f7d7-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:13.976733 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976649    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-installation-pull-secrets\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:13.976733 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976669    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/60427449-1081-4049-a2e8-3665f4dbdd63-snapshots\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:13.976733 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976690    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9703e4a3-5da9-4c15-9f8d-2855f39f0808-installation-pull-secrets\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:13.976733 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976713    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/416a5a6a-c3b4-460e-9382-4ed77d5ca406-nginx-conf\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:13.976845 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976741    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-image-registry-private-configuration\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:13.976845 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976787    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60427449-1081-4049-a2e8-3665f4dbdd63-service-ca-bundle\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:13.976845 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60427449-1081-4049-a2e8-3665f4dbdd63-serving-cert\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:13.976845 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:13.976966 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-tmp-dir\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:13.976966 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976879    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-default-certificate\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:13.976966 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976907    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:13.976966 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1f4fae7b-7758-422b-9271-451c4904c76e-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:13.977130 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976978    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2txv\" (UniqueName: \"kubernetes.io/projected/55811aff-113a-465d-9e99-0e4d78962934-kube-api-access-x2txv\") pod \"volume-data-source-validator-58c9f5f46d-wlt6w\" (UID: \"55811aff-113a-465d-9e99-0e4d78962934\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wlt6w"
Oct 30 21:54:13.977130 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.976998    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-trusted-ca\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:13.977130 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977019    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh7z8\" (UniqueName: \"kubernetes.io/projected/c06a3a88-4b60-4045-b794-e54e3d38068c-kube-api-access-bh7z8\") pod \"ingress-canary-tr6dv\" (UID: \"c06a3a88-4b60-4045-b794-e54e3d38068c\") " pod="openshift-ingress-canary/ingress-canary-tr6dv"
Oct 30 21:54:13.977130 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:13.977130 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977107    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90c31b99-6613-479f-9e60-f028a1967dad-config\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:13.977349 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9703e4a3-5da9-4c15-9f8d-2855f39f0808-image-registry-private-configuration\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:13.977349 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977193    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9703e4a3-5da9-4c15-9f8d-2855f39f0808-ca-trust-extracted\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:13.977349 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zkbx\" (UniqueName: \"kubernetes.io/projected/90c31b99-6613-479f-9e60-f028a1967dad-kube-api-access-8zkbx\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:13.977349 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977248    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjxm9\" (UniqueName: \"kubernetes.io/projected/391964ff-6e62-49e9-89ca-a11cc36d5753-kube-api-access-tjxm9\") pod \"kas-connection-checker-685895c7c9-bhpxt\" (UID: \"391964ff-6e62-49e9-89ca-a11cc36d5753\") " pod="kube-system/kas-connection-checker-685895c7c9-bhpxt"
Oct 30 21:54:13.977349 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977289    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:13.977349 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977319    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9703e4a3-5da9-4c15-9f8d-2855f39f0808-trusted-ca\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:13.977349 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrxfk\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-kube-api-access-qrxfk\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:13.977569 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977364    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c06a3a88-4b60-4045-b794-e54e3d38068c-cert\") pod \"ingress-canary-tr6dv\" (UID: \"c06a3a88-4b60-4045-b794-e54e3d38068c\") " pod="openshift-ingress-canary/ingress-canary-tr6dv"
Oct 30 21:54:13.977569 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977383    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntgj6\" (UniqueName: \"kubernetes.io/projected/60427449-1081-4049-a2e8-3665f4dbdd63-kube-api-access-ntgj6\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:13.977569 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8hdp\" (UniqueName: \"kubernetes.io/projected/fb977621-3d73-4a48-bc4c-a50f67da25d6-kube-api-access-d8hdp\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:13.977569 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977442    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-ca-trust-extracted\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:13.977569 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-bound-sa-token\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:13.977569 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/598df9f3-580f-4014-9abd-a9d84272f7d7-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:13.977569 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977509    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rddz8\" (UniqueName: \"kubernetes.io/projected/6a89d9ac-d62b-42e4-934a-faaa4285277a-kube-api-access-rddz8\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:13.977569 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977528    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txwb8\" (UniqueName: \"kubernetes.io/projected/8a9727e5-7f30-4be7-bc31-9a2af5b0d21e-kube-api-access-txwb8\") pod \"kas-connection-checker-685895c7c9-d9h59\" (UID: \"8a9727e5-7f30-4be7-bc31-9a2af5b0d21e\") " pod="kube-system/kas-connection-checker-685895c7c9-d9h59"
Oct 30 21:54:13.977569 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977546    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90c31b99-6613-479f-9e60-f028a1967dad-serving-cert\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:13.977853 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977572    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d85ad48-ac81-4f99-83d9-9e93db301d40-serving-cert\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:13.977853 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977605    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-certificates\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:13.977853 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.977621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-bound-sa-token\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:13.979943 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.979923    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cc778465d-n66s7"]
Oct 30 21:54:13.981368 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.981351    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 21:54:13.981447 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.981371    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:54:13.981447 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.981435    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 21:54:13.981640 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.981619    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 21:54:13.981727 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.981714    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 21:54:13.981781 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.981726    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 21:54:13.981781 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.981768    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 21:54:13.981781 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.981727    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 21:54:13.981933 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.981862    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 21:54:13.981933 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.981903    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:54:13.981933 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.981925    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 21:54:13.982092 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982075    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:54:13.982238 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982145    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 21:54:13.982238 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982175    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:54:13.982238 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982193    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 21:54:13.982238 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982136    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 21:54:13.982238 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982238    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:54:13.982641 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982339    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:54:13.982641 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982378    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 21:54:13.982641 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982380    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:54:13.982641 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982413    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 21:54:13.982641 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982446    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 21:54:13.982641 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982468    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 21:54:13.982641 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982490    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:54:13.982641 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982507    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 21:54:13.982981 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982732    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 21:54:13.982981 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:13.982863    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:54:14.007206 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.007190    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 21:54:14.032967 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.032939    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 21:54:14.033252 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.033231    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 21:54:14.033444 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.033426    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 21:54:14.033845 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.033826    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8zgsk\""
Oct 30 21:54:14.036276 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.034143    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-j4tgb\""
Oct 30 21:54:14.036276 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.034338    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5khdr\""
Oct 30 21:54:14.036276 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.035380    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-bj87t"]
Oct 30 21:54:14.036276 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.035447    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 21:54:14.036276 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.036091    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 21:54:14.077953 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.077930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zkbx\" (UniqueName: \"kubernetes.io/projected/90c31b99-6613-479f-9e60-f028a1967dad-kube-api-access-8zkbx\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:14.078031 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.077956    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjxm9\" (UniqueName: \"kubernetes.io/projected/391964ff-6e62-49e9-89ca-a11cc36d5753-kube-api-access-tjxm9\") pod \"kas-connection-checker-685895c7c9-bhpxt\" (UID: \"391964ff-6e62-49e9-89ca-a11cc36d5753\") " pod="kube-system/kas-connection-checker-685895c7c9-bhpxt"
Oct 30 21:54:14.078031 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.077979    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:14.078031 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.077998    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9703e4a3-5da9-4c15-9f8d-2855f39f0808-trusted-ca\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.078031 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078021    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrxfk\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-kube-api-access-qrxfk\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.078216 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.078106    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:54:14.078216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078154    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c06a3a88-4b60-4045-b794-e54e3d38068c-cert\") pod \"ingress-canary-tr6dv\" (UID: \"c06a3a88-4b60-4045-b794-e54e3d38068c\") " pod="openshift-ingress-canary/ingress-canary-tr6dv"
Oct 30 21:54:14.078216 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.078164    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls podName:1f4fae7b-7758-422b-9271-451c4904c76e nodeName:}" failed. No retries permitted until 2026-10-30 21:54:14.578145725 +0000 UTC m=+41.687088090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-qvvd7" (UID: "1f4fae7b-7758-422b-9271-451c4904c76e") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:54:14.078216 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078205    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntgj6\" (UniqueName: \"kubernetes.io/projected/60427449-1081-4049-a2e8-3665f4dbdd63-kube-api-access-ntgj6\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:14.078362 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078260    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8hdp\" (UniqueName: \"kubernetes.io/projected/fb977621-3d73-4a48-bc4c-a50f67da25d6-kube-api-access-d8hdp\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:14.078362 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078286    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-ca-trust-extracted\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.078362 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-bound-sa-token\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.078507 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/598df9f3-580f-4014-9abd-a9d84272f7d7-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:14.078507 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078399    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rddz8\" (UniqueName: \"kubernetes.io/projected/6a89d9ac-d62b-42e4-934a-faaa4285277a-kube-api-access-rddz8\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:14.078507 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txwb8\" (UniqueName: \"kubernetes.io/projected/8a9727e5-7f30-4be7-bc31-9a2af5b0d21e-kube-api-access-txwb8\") pod \"kas-connection-checker-685895c7c9-d9h59\" (UID: \"8a9727e5-7f30-4be7-bc31-9a2af5b0d21e\") " pod="kube-system/kas-connection-checker-685895c7c9-d9h59"
Oct 30 21:54:14.078507 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078450    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90c31b99-6613-479f-9e60-f028a1967dad-serving-cert\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:14.078507 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078476    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d85ad48-ac81-4f99-83d9-9e93db301d40-serving-cert\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:14.078810 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078508    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-certificates\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.078810 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-bound-sa-token\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.078810 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078559    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftbtr\" (UniqueName: \"kubernetes.io/projected/b7d2b389-602c-4ef9-a4eb-2caf80e330d0-kube-api-access-ftbtr\") pod \"kas-connection-checker-685895c7c9-x9kk6\" (UID: \"b7d2b389-602c-4ef9-a4eb-2caf80e330d0\") " pod="kube-system/kas-connection-checker-685895c7c9-x9kk6"
Oct 30 21:54:14.078810 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078637    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:14.078810 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078663    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74zs2\" (UniqueName: \"kubernetes.io/projected/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-kube-api-access-74zs2\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:14.078810 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d85ad48-ac81-4f99-83d9-9e93db301d40-trusted-ca\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:14.078810 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.078810 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078767    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60427449-1081-4049-a2e8-3665f4dbdd63-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:14.078810 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhng5\" (UniqueName: \"kubernetes.io/projected/598df9f3-580f-4014-9abd-a9d84272f7d7-kube-api-access-qhng5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078839    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb6hh\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-kube-api-access-zb6hh\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60427449-1081-4049-a2e8-3665f4dbdd63-tmp\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmdfr\" (UniqueName: \"kubernetes.io/projected/9d85ad48-ac81-4f99-83d9-9e93db301d40-kube-api-access-tmdfr\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078949    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-stats-auth\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.078982    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079071    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kjq8\" (UniqueName: \"kubernetes.io/projected/1f4fae7b-7758-422b-9271-451c4904c76e-kube-api-access-6kjq8\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079092    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d85ad48-ac81-4f99-83d9-9e93db301d40-config\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5mdx\" (UniqueName: \"kubernetes.io/projected/318576c4-97c5-473c-9ea5-4a61c104f89f-kube-api-access-h5mdx\") pod \"network-check-source-6f78d59f99-rdsd9\" (UID: \"318576c4-97c5-473c-9ea5-4a61c104f89f\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rdsd9"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-config-volume\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-certificates\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079178    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9703e4a3-5da9-4c15-9f8d-2855f39f0808-trusted-ca\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079202    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/598df9f3-580f-4014-9abd-a9d84272f7d7-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:14.079225 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-installation-pull-secrets\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.079877 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079252    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/60427449-1081-4049-a2e8-3665f4dbdd63-snapshots\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:14.079877 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.079319    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:54:14.079877 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.079334    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9c975d75-kkjl6: secret "image-registry-tls" not found
Oct 30 21:54:14.079877 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.079377    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls podName:cf5df1af-34a5-4168-9f99-b1e8319f6f2b nodeName:}" failed. No retries permitted until 2026-10-30 21:54:14.579362491 +0000 UTC m=+41.688304842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls") pod "image-registry-5b9c975d75-kkjl6" (UID: "cf5df1af-34a5-4168-9f99-b1e8319f6f2b") : secret "image-registry-tls" not found
Oct 30 21:54:14.079877 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079451    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-ca-trust-extracted\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.079877 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079626    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9703e4a3-5da9-4c15-9f8d-2855f39f0808-installation-pull-secrets\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.079877 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/416a5a6a-c3b4-460e-9382-4ed77d5ca406-nginx-conf\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:14.079877 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-image-registry-private-configuration\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.079877 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60427449-1081-4049-a2e8-3665f4dbdd63-service-ca-bundle\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:14.079877 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079769    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60427449-1081-4049-a2e8-3665f4dbdd63-serving-cert\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:14.079877 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079795    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:14.079877 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079822    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-tmp-dir\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:14.079877 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-default-certificate\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079885    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1f4fae7b-7758-422b-9271-451c4904c76e-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2txv\" (UniqueName: \"kubernetes.io/projected/55811aff-113a-465d-9e99-0e4d78962934-kube-api-access-x2txv\") pod \"volume-data-source-validator-58c9f5f46d-wlt6w\" (UID: \"55811aff-113a-465d-9e99-0e4d78962934\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wlt6w"
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.079988    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-trusted-ca\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.080015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh7z8\" (UniqueName: \"kubernetes.io/projected/c06a3a88-4b60-4045-b794-e54e3d38068c-kube-api-access-bh7z8\") pod \"ingress-canary-tr6dv\" (UID: \"c06a3a88-4b60-4045-b794-e54e3d38068c\") " pod="openshift-ingress-canary/ingress-canary-tr6dv"
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.080024    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.080056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.080083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90c31b99-6613-479f-9e60-f028a1967dad-config\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.080104    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls podName:4a4f3ab5-fba1-457f-bd3f-2d760bf6372c nodeName:}" failed. No retries permitted until 2026-10-30 21:54:14.580087601 +0000 UTC m=+41.689029954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls") pod "dns-default-rbmtp" (UID: "4a4f3ab5-fba1-457f-bd3f-2d760bf6372c") : secret "dns-default-metrics-tls" not found
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.080138    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d85ad48-ac81-4f99-83d9-9e93db301d40-trusted-ca\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.080147    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.080156    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9703e4a3-5da9-4c15-9f8d-2855f39f0808-image-registry-private-configuration\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.080185    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9703e4a3-5da9-4c15-9f8d-2855f39f0808-ca-trust-extracted\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.080192    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/60427449-1081-4049-a2e8-3665f4dbdd63-snapshots\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.080270    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:54:14.080536 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.080309    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs podName:fb977621-3d73-4a48-bc4c-a50f67da25d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:14.580296363 +0000 UTC m=+41.689238752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs") pod "router-default-5c6c4f6cbf-rnprt" (UID: "fb977621-3d73-4a48-bc4c-a50f67da25d6") : secret "router-metrics-certs-default" not found
Oct 30 21:54:14.081312 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.080478    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle podName:fb977621-3d73-4a48-bc4c-a50f67da25d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:14.580462801 +0000 UTC m=+41.689405174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle") pod "router-default-5c6c4f6cbf-rnprt" (UID: "fb977621-3d73-4a48-bc4c-a50f67da25d6") : configmap references non-existent config key: service-ca.crt
Oct 30 21:54:14.081312 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.080632    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90c31b99-6613-479f-9e60-f028a1967dad-config\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:14.081312 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.080774    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-certificates\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.081312 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.081165    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60427449-1081-4049-a2e8-3665f4dbdd63-service-ca-bundle\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:14.081511 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.081325    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d85ad48-ac81-4f99-83d9-9e93db301d40-config\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:14.081511 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.081385    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/416a5a6a-c3b4-460e-9382-4ed77d5ca406-nginx-conf\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:14.081511 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.081409    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60427449-1081-4049-a2e8-3665f4dbdd63-tmp\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:14.082621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.081980    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-config-volume\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:14.082621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.082198    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9703e4a3-5da9-4c15-9f8d-2855f39f0808-ca-trust-extracted\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.082621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.082441    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60427449-1081-4049-a2e8-3665f4dbdd63-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:14.082813 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.082787    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/598df9f3-580f-4014-9abd-a9d84272f7d7-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:14.082874 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.082791    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1f4fae7b-7758-422b-9271-451c4904c76e-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:14.082874 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.082868    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:54:14.082971 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.082911    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls podName:6a89d9ac-d62b-42e4-934a-faaa4285277a nodeName:}" failed. No retries permitted until 2026-10-30 21:54:14.582897968 +0000 UTC m=+41.691840336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-t4r5j" (UID: "6a89d9ac-d62b-42e4-934a-faaa4285277a") : secret "samples-operator-tls" not found
Oct 30 21:54:14.082971 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.082950    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-certificates\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.083648 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.083094    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:54:14.083648 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.083164    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-tmp-dir\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:14.083648 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.083194    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert podName:416a5a6a-c3b4-460e-9382-4ed77d5ca406 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:14.583178243 +0000 UTC m=+41.692120595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-bj87t" (UID: "416a5a6a-c3b4-460e-9382-4ed77d5ca406") : secret "networking-console-plugin-cert" not found
Oct 30 21:54:14.083648 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.083264    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:54:14.083648 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.083276    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cc778465d-n66s7: secret "image-registry-tls" not found
Oct 30 21:54:14.083648 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.083316    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls podName:9703e4a3-5da9-4c15-9f8d-2855f39f0808 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:14.583302806 +0000 UTC m=+41.692245161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls") pod "image-registry-5cc778465d-n66s7" (UID: "9703e4a3-5da9-4c15-9f8d-2855f39f0808") : secret "image-registry-tls" not found
Oct 30 21:54:14.083648 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.083386    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-trusted-ca\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.084038 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.083672    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/598df9f3-580f-4014-9abd-a9d84272f7d7-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:14.084211 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.084184    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c06a3a88-4b60-4045-b794-e54e3d38068c-cert\") pod \"ingress-canary-tr6dv\" (UID: \"c06a3a88-4b60-4045-b794-e54e3d38068c\") " pod="openshift-ingress-canary/ingress-canary-tr6dv"
Oct 30 21:54:14.084844 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.084800    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d85ad48-ac81-4f99-83d9-9e93db301d40-serving-cert\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:14.084937 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.084883    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-image-registry-private-configuration\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.085010 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.084987    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60427449-1081-4049-a2e8-3665f4dbdd63-serving-cert\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:14.085538 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.085513    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90c31b99-6613-479f-9e60-f028a1967dad-serving-cert\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:14.085647 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.085543    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-default-certificate\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:14.086030 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.086007    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9703e4a3-5da9-4c15-9f8d-2855f39f0808-installation-pull-secrets\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.086336 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.086318    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-installation-pull-secrets\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.086400 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.086380    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-stats-auth\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:14.086493 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.086477    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9703e4a3-5da9-4c15-9f8d-2855f39f0808-image-registry-private-configuration\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.144254 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.144192    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjxm9\" (UniqueName: \"kubernetes.io/projected/391964ff-6e62-49e9-89ca-a11cc36d5753-kube-api-access-tjxm9\") pod \"kas-connection-checker-685895c7c9-bhpxt\" (UID: \"391964ff-6e62-49e9-89ca-a11cc36d5753\") " pod="kube-system/kas-connection-checker-685895c7c9-bhpxt"
Oct 30 21:54:14.144460 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.144442    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrxfk\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-kube-api-access-qrxfk\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.144532 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.144485    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8hdp\" (UniqueName: \"kubernetes.io/projected/fb977621-3d73-4a48-bc4c-a50f67da25d6-kube-api-access-d8hdp\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:14.146234 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.146211    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-bhpxt"
Oct 30 21:54:14.146715 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.146696    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh7z8\" (UniqueName: \"kubernetes.io/projected/c06a3a88-4b60-4045-b794-e54e3d38068c-kube-api-access-bh7z8\") pod \"ingress-canary-tr6dv\" (UID: \"c06a3a88-4b60-4045-b794-e54e3d38068c\") " pod="openshift-ingress-canary/ingress-canary-tr6dv"
Oct 30 21:54:14.147284 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.147046    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zkbx\" (UniqueName: \"kubernetes.io/projected/90c31b99-6613-479f-9e60-f028a1967dad-kube-api-access-8zkbx\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:14.147284 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.147204    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftbtr\" (UniqueName: \"kubernetes.io/projected/b7d2b389-602c-4ef9-a4eb-2caf80e330d0-kube-api-access-ftbtr\") pod \"kas-connection-checker-685895c7c9-x9kk6\" (UID: \"b7d2b389-602c-4ef9-a4eb-2caf80e330d0\") " pod="kube-system/kas-connection-checker-685895c7c9-x9kk6"
Oct 30 21:54:14.148331 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.148289    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-bound-sa-token\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.149157 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.148765    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb6hh\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-kube-api-access-zb6hh\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.149157 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.148946    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5mdx\" (UniqueName: \"kubernetes.io/projected/318576c4-97c5-473c-9ea5-4a61c104f89f-kube-api-access-h5mdx\") pod \"network-check-source-6f78d59f99-rdsd9\" (UID: \"318576c4-97c5-473c-9ea5-4a61c104f89f\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rdsd9"
Oct 30 21:54:14.150004 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.149316    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2txv\" (UniqueName: \"kubernetes.io/projected/55811aff-113a-465d-9e99-0e4d78962934-kube-api-access-x2txv\") pod \"volume-data-source-validator-58c9f5f46d-wlt6w\" (UID: \"55811aff-113a-465d-9e99-0e4d78962934\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wlt6w"
Oct 30 21:54:14.150004 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.149937    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhng5\" (UniqueName: \"kubernetes.io/projected/598df9f3-580f-4014-9abd-a9d84272f7d7-kube-api-access-qhng5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:14.151913 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.151786    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rddz8\" (UniqueName: \"kubernetes.io/projected/6a89d9ac-d62b-42e4-934a-faaa4285277a-kube-api-access-rddz8\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:14.151913 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.151794    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74zs2\" (UniqueName: \"kubernetes.io/projected/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-kube-api-access-74zs2\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:14.152141 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.152121    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-x9kk6"
Oct 30 21:54:14.152285 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.152262    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txwb8\" (UniqueName: \"kubernetes.io/projected/8a9727e5-7f30-4be7-bc31-9a2af5b0d21e-kube-api-access-txwb8\") pod \"kas-connection-checker-685895c7c9-d9h59\" (UID: \"8a9727e5-7f30-4be7-bc31-9a2af5b0d21e\") " pod="kube-system/kas-connection-checker-685895c7c9-d9h59"
Oct 30 21:54:14.152377 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.152357    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmdfr\" (UniqueName: \"kubernetes.io/projected/9d85ad48-ac81-4f99-83d9-9e93db301d40-kube-api-access-tmdfr\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:14.152651 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.152626    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntgj6\" (UniqueName: \"kubernetes.io/projected/60427449-1081-4049-a2e8-3665f4dbdd63-kube-api-access-ntgj6\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:14.152757 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.152658    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kjq8\" (UniqueName: \"kubernetes.io/projected/1f4fae7b-7758-422b-9271-451c4904c76e-kube-api-access-6kjq8\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:14.154008 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.153985    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-bound-sa-token\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.160284 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.160267    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:14.181858 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.181684    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:14.198364 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.196068    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wlt6w"
Oct 30 21:54:14.198734 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.198572    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:14.210419 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.210236    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:14.234212 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.234043    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rdsd9"
Oct 30 21:54:14.245076 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.240099    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tr6dv"
Oct 30 21:54:14.406658 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.406602    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:14.439148 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.439123    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-d9h59"
Oct 30 21:54:14.461896 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.461692    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:54:14.462023 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.461949    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-66njg\""
Oct 30 21:54:14.547897 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.547667    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-x9kk6"]
Oct 30 21:54:14.549912 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.549892    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bhpxt"]
Oct 30 21:54:14.552640 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:54:14.552617    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d2b389_602c_4ef9_a4eb_2caf80e330d0.slice/crio-3f3f05e46b1874d6a32d6e1a7043cd9240cf260cf8f6501b7e634201e10abcb5 WatchSource:0}: Error finding container 3f3f05e46b1874d6a32d6e1a7043cd9240cf260cf8f6501b7e634201e10abcb5: Status 404 returned error can't find the container with id 3f3f05e46b1874d6a32d6e1a7043cd9240cf260cf8f6501b7e634201e10abcb5
Oct 30 21:54:14.553197 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:54:14.553139    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod391964ff_6e62_49e9_89ca_a11cc36d5753.slice/crio-e8ad6808c5646869c98eb6e37029a9c4e1555e3df82d63c6b6f9e83e35266d60 WatchSource:0}: Error finding container e8ad6808c5646869c98eb6e37029a9c4e1555e3df82d63c6b6f9e83e35266d60: Status 404 returned error can't find the container with id e8ad6808c5646869c98eb6e37029a9c4e1555e3df82d63c6b6f9e83e35266d60
Oct 30 21:54:14.556325 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.556301    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-dglp8"]
Oct 30 21:54:14.558901 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:54:14.558871    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60427449_1081_4049_a2e8_3665f4dbdd63.slice/crio-d979ddadcd6c33812034606292686cf42cef483e5144a9bdf23e63433b19f454 WatchSource:0}: Error finding container d979ddadcd6c33812034606292686cf42cef483e5144a9bdf23e63433b19f454: Status 404 returned error can't find the container with id d979ddadcd6c33812034606292686cf42cef483e5144a9bdf23e63433b19f454
Oct 30 21:54:14.584855 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.584831    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"]
Oct 30 21:54:14.585156 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.585131    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:14.585253 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.585186    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:14.585253 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.585215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:14.585365 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.585278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:14.585365 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.585309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:14.585365 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.585349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:14.585514 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.585382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:14.585514 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.585448    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:14.585634 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.585583    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:54:14.585634 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.585615    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9c975d75-kkjl6: secret "image-registry-tls" not found
Oct 30 21:54:14.585735 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.585664    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls podName:cf5df1af-34a5-4168-9f99-b1e8319f6f2b nodeName:}" failed. No retries permitted until 2026-10-30 21:54:15.585648055 +0000 UTC m=+42.694590407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls") pod "image-registry-5b9c975d75-kkjl6" (UID: "cf5df1af-34a5-4168-9f99-b1e8319f6f2b") : secret "image-registry-tls" not found
Oct 30 21:54:14.585799 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.585735    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:54:14.585799 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.585768    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs podName:fb977621-3d73-4a48-bc4c-a50f67da25d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:15.585758843 +0000 UTC m=+42.694701197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs") pod "router-default-5c6c4f6cbf-rnprt" (UID: "fb977621-3d73-4a48-bc4c-a50f67da25d6") : secret "router-metrics-certs-default" not found
Oct 30 21:54:14.585899 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.585825    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:54:14.585899 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.585852    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls podName:4a4f3ab5-fba1-457f-bd3f-2d760bf6372c nodeName:}" failed. No retries permitted until 2026-10-30 21:54:15.585842692 +0000 UTC m=+42.694785045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls") pod "dns-default-rbmtp" (UID: "4a4f3ab5-fba1-457f-bd3f-2d760bf6372c") : secret "dns-default-metrics-tls" not found
Oct 30 21:54:14.585998 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.585920    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle podName:fb977621-3d73-4a48-bc4c-a50f67da25d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:15.585909471 +0000 UTC m=+42.694851823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle") pod "router-default-5c6c4f6cbf-rnprt" (UID: "fb977621-3d73-4a48-bc4c-a50f67da25d6") : configmap references non-existent config key: service-ca.crt
Oct 30 21:54:14.585998 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.585981    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:54:14.586088 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.586020    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls podName:6a89d9ac-d62b-42e4-934a-faaa4285277a nodeName:}" failed. No retries permitted until 2026-10-30 21:54:15.585998754 +0000 UTC m=+42.694941106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-t4r5j" (UID: "6a89d9ac-d62b-42e4-934a-faaa4285277a") : secret "samples-operator-tls" not found
Oct 30 21:54:14.586088 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.586071    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:54:14.586179 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.586097    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert podName:416a5a6a-c3b4-460e-9382-4ed77d5ca406 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:15.586089234 +0000 UTC m=+42.695031588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-bj87t" (UID: "416a5a6a-c3b4-460e-9382-4ed77d5ca406") : secret "networking-console-plugin-cert" not found
Oct 30 21:54:14.586179 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.586146    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:54:14.586179 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.586155    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cc778465d-n66s7: secret "image-registry-tls" not found
Oct 30 21:54:14.586179 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.586178    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls podName:9703e4a3-5da9-4c15-9f8d-2855f39f0808 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:15.586169887 +0000 UTC m=+42.695112241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls") pod "image-registry-5cc778465d-n66s7" (UID: "9703e4a3-5da9-4c15-9f8d-2855f39f0808") : secret "image-registry-tls" not found
Oct 30 21:54:14.586377 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.586232    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:54:14.586377 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:14.586261    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls podName:1f4fae7b-7758-422b-9271-451c4904c76e nodeName:}" failed. No retries permitted until 2026-10-30 21:54:15.586251261 +0000 UTC m=+42.695193615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-qvvd7" (UID: "1f4fae7b-7758-422b-9271-451c4904c76e") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:54:14.588756 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.588720    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-dglp8" event={"ID":"60427449-1081-4049-a2e8-3665f4dbdd63","Type":"ContainerStarted","Data":"d979ddadcd6c33812034606292686cf42cef483e5144a9bdf23e63433b19f454"}
Oct 30 21:54:14.589463 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:54:14.589434    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod598df9f3_580f_4014_9abd_a9d84272f7d7.slice/crio-c059583a05f2a3587fe310359be8c83c05edc8b57a5b8ed03bdc022bbdf67b2e WatchSource:0}: Error finding container c059583a05f2a3587fe310359be8c83c05edc8b57a5b8ed03bdc022bbdf67b2e: Status 404 returned error can't find the container with id c059583a05f2a3587fe310359be8c83c05edc8b57a5b8ed03bdc022bbdf67b2e
Oct 30 21:54:14.590495 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.590473    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-x9kk6" event={"ID":"b7d2b389-602c-4ef9-a4eb-2caf80e330d0","Type":"ContainerStarted","Data":"3f3f05e46b1874d6a32d6e1a7043cd9240cf260cf8f6501b7e634201e10abcb5"}
Oct 30 21:54:14.592708 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.592688    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-bhpxt" event={"ID":"391964ff-6e62-49e9-89ca-a11cc36d5753","Type":"ContainerStarted","Data":"e8ad6808c5646869c98eb6e37029a9c4e1555e3df82d63c6b6f9e83e35266d60"}
Oct 30 21:54:14.610798 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.610774    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wlt6w"]
Oct 30 21:54:14.613917 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:54:14.613891    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55811aff_113a_465d_9e99_0e4d78962934.slice/crio-685a63a047a0a56db4b88892d89d1078fc3f10f05eeca1d9612b0f3ea9e4c325 WatchSource:0}: Error finding container 685a63a047a0a56db4b88892d89d1078fc3f10f05eeca1d9612b0f3ea9e4c325: Status 404 returned error can't find the container with id 685a63a047a0a56db4b88892d89d1078fc3f10f05eeca1d9612b0f3ea9e4c325
Oct 30 21:54:14.635168 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.635145    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"]
Oct 30 21:54:14.638040 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.638020    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-57lx9"]
Oct 30 21:54:14.646549 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:54:14.646518    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d85ad48_ac81_4f99_83d9_9e93db301d40.slice/crio-5096ecdc5fc157feab59a8eeb6452be018b66c80e9aaa1b4d9b2a9019b81aa49 WatchSource:0}: Error finding container 5096ecdc5fc157feab59a8eeb6452be018b66c80e9aaa1b4d9b2a9019b81aa49: Status 404 returned error can't find the container with id 5096ecdc5fc157feab59a8eeb6452be018b66c80e9aaa1b4d9b2a9019b81aa49
Oct 30 21:54:14.646924 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:54:14.646902    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c31b99_6613_479f_9e60_f028a1967dad.slice/crio-7b904dda6f90486dc5b247fdd4ccd97b44f0a0186a6183f0f8b8012d83adb62e WatchSource:0}: Error finding container 7b904dda6f90486dc5b247fdd4ccd97b44f0a0186a6183f0f8b8012d83adb62e: Status 404 returned error can't find the container with id 7b904dda6f90486dc5b247fdd4ccd97b44f0a0186a6183f0f8b8012d83adb62e
Oct 30 21:54:14.674527 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.674502    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tr6dv"]
Oct 30 21:54:14.675499 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.675473    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-rdsd9"]
Oct 30 21:54:14.686483 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:54:14.686436    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod318576c4_97c5_473c_9ea5_4a61c104f89f.slice/crio-9ff3304cc05d75aafccd25a3a4b746994a261c81884ac25a425ccaaff4c5308b WatchSource:0}: Error finding container 9ff3304cc05d75aafccd25a3a4b746994a261c81884ac25a425ccaaff4c5308b: Status 404 returned error can't find the container with id 9ff3304cc05d75aafccd25a3a4b746994a261c81884ac25a425ccaaff4c5308b
Oct 30 21:54:14.806189 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:14.806154    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-d9h59"]
Oct 30 21:54:14.810555 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:54:14.810530    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9727e5_7f30_4be7_bc31_9a2af5b0d21e.slice/crio-eeb16e36e570980d9658b5271aaf40808802a15b4c4db30a80d656a266c06aa4 WatchSource:0}: Error finding container eeb16e36e570980d9658b5271aaf40808802a15b4c4db30a80d656a266c06aa4: Status 404 returned error can't find the container with id eeb16e36e570980d9658b5271aaf40808802a15b4c4db30a80d656a266c06aa4
Oct 30 21:54:15.412481 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.412455    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:15.412647 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.412458    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:15.465942 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.465913    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-fd64m\""
Oct 30 21:54:15.466320 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.466023    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-c7qtj\""
Oct 30 21:54:15.466320 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.466095    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.596610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.596664    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.596708    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.596736    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.596798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.596833    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.596875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.596910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.597035    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.597091    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls podName:1f4fae7b-7758-422b-9271-451c4904c76e nodeName:}" failed. No retries permitted until 2026-10-30 21:54:17.597072931 +0000 UTC m=+44.706015288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-qvvd7" (UID: "1f4fae7b-7758-422b-9271-451c4904c76e") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.597158    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.597170    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9c975d75-kkjl6: secret "image-registry-tls" not found
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.597203    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls podName:cf5df1af-34a5-4168-9f99-b1e8319f6f2b nodeName:}" failed. No retries permitted until 2026-10-30 21:54:17.597191987 +0000 UTC m=+44.706134341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls") pod "image-registry-5b9c975d75-kkjl6" (UID: "cf5df1af-34a5-4168-9f99-b1e8319f6f2b") : secret "image-registry-tls" not found
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.597256    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.597287    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs podName:fb977621-3d73-4a48-bc4c-a50f67da25d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:17.597276794 +0000 UTC m=+44.706219150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs") pod "router-default-5c6c4f6cbf-rnprt" (UID: "fb977621-3d73-4a48-bc4c-a50f67da25d6") : secret "router-metrics-certs-default" not found
Oct 30 21:54:15.597615 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.597337    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:54:15.598885 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.597364    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls podName:4a4f3ab5-fba1-457f-bd3f-2d760bf6372c nodeName:}" failed. No retries permitted until 2026-10-30 21:54:17.597354373 +0000 UTC m=+44.706296727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls") pod "dns-default-rbmtp" (UID: "4a4f3ab5-fba1-457f-bd3f-2d760bf6372c") : secret "dns-default-metrics-tls" not found
Oct 30 21:54:15.598885 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.597430    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle podName:fb977621-3d73-4a48-bc4c-a50f67da25d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:17.597420679 +0000 UTC m=+44.706363032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle") pod "router-default-5c6c4f6cbf-rnprt" (UID: "fb977621-3d73-4a48-bc4c-a50f67da25d6") : configmap references non-existent config key: service-ca.crt
Oct 30 21:54:15.598885 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.597492    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:54:15.598885 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.597522    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls podName:6a89d9ac-d62b-42e4-934a-faaa4285277a nodeName:}" failed. No retries permitted until 2026-10-30 21:54:17.597510759 +0000 UTC m=+44.706453114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-t4r5j" (UID: "6a89d9ac-d62b-42e4-934a-faaa4285277a") : secret "samples-operator-tls" not found
Oct 30 21:54:15.598885 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.597576    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:54:15.598885 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.598760    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:54:15.598885 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.598774    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cc778465d-n66s7: secret "image-registry-tls" not found
Oct 30 21:54:15.598885 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.598819    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls podName:9703e4a3-5da9-4c15-9f8d-2855f39f0808 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:17.598803738 +0000 UTC m=+44.707746095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls") pod "image-registry-5cc778465d-n66s7" (UID: "9703e4a3-5da9-4c15-9f8d-2855f39f0808") : secret "image-registry-tls" not found
Oct 30 21:54:15.599365 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:15.599341    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert podName:416a5a6a-c3b4-460e-9382-4ed77d5ca406 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:17.599323217 +0000 UTC m=+44.708265571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-bj87t" (UID: "416a5a6a-c3b4-460e-9382-4ed77d5ca406") : secret "networking-console-plugin-cert" not found
Oct 30 21:54:15.606374 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.606291    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rdsd9" event={"ID":"318576c4-97c5-473c-9ea5-4a61c104f89f","Type":"ContainerStarted","Data":"9ff3304cc05d75aafccd25a3a4b746994a261c81884ac25a425ccaaff4c5308b"}
Oct 30 21:54:15.609052 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.609026    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wlt6w" event={"ID":"55811aff-113a-465d-9e99-0e4d78962934","Type":"ContainerStarted","Data":"685a63a047a0a56db4b88892d89d1078fc3f10f05eeca1d9612b0f3ea9e4c325"}
Oct 30 21:54:15.611318 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.611291    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-bhpxt" event={"ID":"391964ff-6e62-49e9-89ca-a11cc36d5753","Type":"ContainerStarted","Data":"ebfc4778d9615784e40503a03ab0f70cbc0e17272aae8b6d89f765e1575cc9e7"}
Oct 30 21:54:15.613956 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.613929    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9" event={"ID":"9d85ad48-ac81-4f99-83d9-9e93db301d40","Type":"ContainerStarted","Data":"5096ecdc5fc157feab59a8eeb6452be018b66c80e9aaa1b4d9b2a9019b81aa49"}
Oct 30 21:54:15.615513 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.615493    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9" event={"ID":"598df9f3-580f-4014-9abd-a9d84272f7d7","Type":"ContainerStarted","Data":"c059583a05f2a3587fe310359be8c83c05edc8b57a5b8ed03bdc022bbdf67b2e"}
Oct 30 21:54:15.617504 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.617479    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-x9kk6" event={"ID":"b7d2b389-602c-4ef9-a4eb-2caf80e330d0","Type":"ContainerStarted","Data":"a5305749cf2b933411a5f7c4eb8781ac436264ad0c5868d9da9fdc82be41cbaf"}
Oct 30 21:54:15.624020 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.623996    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-d9h59" event={"ID":"8a9727e5-7f30-4be7-bc31-9a2af5b0d21e","Type":"ContainerStarted","Data":"621c466afd58111b34d42ddc35b7ef717f7dd8fefd6232ee5a1710d5746eaa98"}
Oct 30 21:54:15.624106 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.624039    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-d9h59" event={"ID":"8a9727e5-7f30-4be7-bc31-9a2af5b0d21e","Type":"ContainerStarted","Data":"eeb16e36e570980d9658b5271aaf40808802a15b4c4db30a80d656a266c06aa4"}
Oct 30 21:54:15.628155 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.628131    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tr6dv" event={"ID":"c06a3a88-4b60-4045-b794-e54e3d38068c","Type":"ContainerStarted","Data":"511b57184e1dc4b98fdb1a27ded2834c8db4fb0b76899da2455479a7a8c7844b"}
Oct 30 21:54:15.629659 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:15.629637    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7" event={"ID":"90c31b99-6613-479f-9e60-f028a1967dad","Type":"ContainerStarted","Data":"7b904dda6f90486dc5b247fdd4ccd97b44f0a0186a6183f0f8b8012d83adb62e"}
Oct 30 21:54:16.009781 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:16.009723    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-d9h59" podStartSLOduration=335.009704802 podStartE2EDuration="5m35.009704802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:16.007771984 +0000 UTC m=+43.116714360" watchObservedRunningTime="2026-10-30 21:54:16.009704802 +0000 UTC m=+43.118647176"
Oct 30 21:54:16.126197 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:16.125992    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-bhpxt" podStartSLOduration=335.125975018 podStartE2EDuration="5m35.125975018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:16.125279117 +0000 UTC m=+43.234221491" watchObservedRunningTime="2026-10-30 21:54:16.125975018 +0000 UTC m=+43.234917387"
Oct 30 21:54:17.040977 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:17.040944    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:17.454686 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:17.454575    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:17.616286    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:17.616346    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:17.616387    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:17.616415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:17.616469    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:17.616496    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:17.616523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:17.616572    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.616702    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.616751    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls podName:1f4fae7b-7758-422b-9271-451c4904c76e nodeName:}" failed. No retries permitted until 2026-10-30 21:54:21.616738196 +0000 UTC m=+48.725680547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-qvvd7" (UID: "1f4fae7b-7758-422b-9271-451c4904c76e") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617086    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617098    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9c975d75-kkjl6: secret "image-registry-tls" not found
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617133    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls podName:cf5df1af-34a5-4168-9f99-b1e8319f6f2b nodeName:}" failed. No retries permitted until 2026-10-30 21:54:21.617123248 +0000 UTC m=+48.726065599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls") pod "image-registry-5b9c975d75-kkjl6" (UID: "cf5df1af-34a5-4168-9f99-b1e8319f6f2b") : secret "image-registry-tls" not found
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617175    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617205    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs podName:fb977621-3d73-4a48-bc4c-a50f67da25d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:21.617195494 +0000 UTC m=+48.726137881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs") pod "router-default-5c6c4f6cbf-rnprt" (UID: "fb977621-3d73-4a48-bc4c-a50f67da25d6") : secret "router-metrics-certs-default" not found
Oct 30 21:54:17.617565 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617248    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:54:17.618324 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617276    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls podName:4a4f3ab5-fba1-457f-bd3f-2d760bf6372c nodeName:}" failed. No retries permitted until 2026-10-30 21:54:21.6172662 +0000 UTC m=+48.726208552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls") pod "dns-default-rbmtp" (UID: "4a4f3ab5-fba1-457f-bd3f-2d760bf6372c") : secret "dns-default-metrics-tls" not found
Oct 30 21:54:17.618324 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617325    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle podName:fb977621-3d73-4a48-bc4c-a50f67da25d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:21.617318197 +0000 UTC m=+48.726260562 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle") pod "router-default-5c6c4f6cbf-rnprt" (UID: "fb977621-3d73-4a48-bc4c-a50f67da25d6") : configmap references non-existent config key: service-ca.crt
Oct 30 21:54:17.618324 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617358    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:54:17.618324 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617382    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls podName:6a89d9ac-d62b-42e4-934a-faaa4285277a nodeName:}" failed. No retries permitted until 2026-10-30 21:54:21.617373502 +0000 UTC m=+48.726315866 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-t4r5j" (UID: "6a89d9ac-d62b-42e4-934a-faaa4285277a") : secret "samples-operator-tls" not found
Oct 30 21:54:17.618324 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617429    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:54:17.618324 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617455    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert podName:416a5a6a-c3b4-460e-9382-4ed77d5ca406 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:21.617448469 +0000 UTC m=+48.726390835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-bj87t" (UID: "416a5a6a-c3b4-460e-9382-4ed77d5ca406") : secret "networking-console-plugin-cert" not found
Oct 30 21:54:17.618324 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617508    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:54:17.618324 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617516    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cc778465d-n66s7: secret "image-registry-tls" not found
Oct 30 21:54:17.618324 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:17.617534    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls podName:9703e4a3-5da9-4c15-9f8d-2855f39f0808 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:21.617529049 +0000 UTC m=+48.726471414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls") pod "image-registry-5cc778465d-n66s7" (UID: "9703e4a3-5da9-4c15-9f8d-2855f39f0808") : secret "image-registry-tls" not found
Oct 30 21:54:17.642977 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:17.642945    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wlt6w" event={"ID":"55811aff-113a-465d-9e99-0e4d78962934","Type":"ContainerStarted","Data":"078d9975a533d357d845e5ce1794bf742bd8c9a9d62860ab8d641210f81db980"}
Oct 30 21:54:17.765872 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:17.765775    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-x9kk6" podStartSLOduration=336.7657564 podStartE2EDuration="5m36.7657564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:16.244130857 +0000 UTC m=+43.353073232" watchObservedRunningTime="2026-10-30 21:54:17.7657564 +0000 UTC m=+44.874698774"
Oct 30 21:54:17.766844 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:17.766804    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wlt6w" podStartSLOduration=308.47764999 podStartE2EDuration="5m10.766794097s" totalImagesPullingTime="2.289144107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:17.763025172 +0000 UTC m=+44.871967574" watchObservedRunningTime="2026-10-30 21:54:17.766794097 +0000 UTC m=+44.875736470"
Oct 30 21:54:18.150546 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:18.150511    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:18.437920 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:18.437842    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:19.123123 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:19.123092    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:19.368229 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:19.368149    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:19.651689 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:19.651622    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/0.log"
Oct 30 21:54:19.651689 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:19.651661    2575 generic.go:356] "Generic (PLEG): container finished" podID="9d85ad48-ac81-4f99-83d9-9e93db301d40" containerID="073ea8dae66c853156937471065a063aaf92f4e0360bd76120e8b02c9bf7cf5c" exitCode=255
Oct 30 21:54:19.651899 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:19.651753    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9" event={"ID":"9d85ad48-ac81-4f99-83d9-9e93db301d40","Type":"ContainerDied","Data":"073ea8dae66c853156937471065a063aaf92f4e0360bd76120e8b02c9bf7cf5c"}
Oct 30 21:54:19.651992 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:19.651971    2575 scope.go:122] "RemoveContainer" containerID="073ea8dae66c853156937471065a063aaf92f4e0360bd76120e8b02c9bf7cf5c"
Oct 30 21:54:19.653743 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:19.653513    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9" event={"ID":"598df9f3-580f-4014-9abd-a9d84272f7d7","Type":"ContainerStarted","Data":"3958ec64ede0b5869c614cc139fb94165a34cf74f53be0e4173f6610f9359c9c"}
Oct 30 21:54:19.655807 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:19.655783    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-dglp8" event={"ID":"60427449-1081-4049-a2e8-3665f4dbdd63","Type":"ContainerStarted","Data":"36aafe4f25c45828bd377bcb5cad3ea386e9d2c6f4bd85049162d7c95d882de9"}
Oct 30 21:54:19.657383 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:19.657362    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7" event={"ID":"90c31b99-6613-479f-9e60-f028a1967dad","Type":"ContainerStarted","Data":"52f58ddb185dfb372aab0387143bf153a453213eec2a6ea03de6c777daae347d"}
Oct 30 21:54:19.896249 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:19.896174    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9" podStartSLOduration=308.278311465 podStartE2EDuration="5m12.896155113s" totalImagesPullingTime="4.617843648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:19.895271437 +0000 UTC m=+47.004213810" watchObservedRunningTime="2026-10-30 21:54:19.896155113 +0000 UTC m=+47.005097487"
Oct 30 21:54:20.137124 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.137059    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-dglp8" podStartSLOduration=308.91880298 podStartE2EDuration="5m13.137036698s" totalImagesPullingTime="4.218233718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:20.027789114 +0000 UTC m=+47.136731515" watchObservedRunningTime="2026-10-30 21:54:20.137036698 +0000 UTC m=+47.245979087"
Oct 30 21:54:20.137716 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.137690    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s6x2r"]
Oct 30 21:54:20.140208 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.140183    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.162459 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.162420    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7" podStartSLOduration=308.707702746 podStartE2EDuration="5m13.162406835s" totalImagesPullingTime="4.454704089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:20.16113668 +0000 UTC m=+47.270079054" watchObservedRunningTime="2026-10-30 21:54:20.162406835 +0000 UTC m=+47.271349208"
Oct 30 21:54:20.193826 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.193809    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 21:54:20.193935 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.193914    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-plmg6\""
Oct 30 21:54:20.196115 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.196017    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 21:54:20.208888 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.208862    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s6x2r"]
Oct 30 21:54:20.245432 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.245409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-data-volume\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.245530 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.245439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.245530 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.245456    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgnbc\" (UniqueName: \"kubernetes.io/projected/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-api-access-lgnbc\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.245775 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.245760    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.245875 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.245806    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-crio-socket\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.352248 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.347818    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.352248 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.347906    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-crio-socket\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.352248 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.347938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-data-volume\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.352248 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.347971    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.352248 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.347998    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgnbc\" (UniqueName: \"kubernetes.io/projected/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-api-access-lgnbc\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.352248 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:20.348451    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:54:20.352248 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:20.348526    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm podName:9f9c30fb-c07a-4566-8f99-7ddb1ee9da13 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:20.848507383 +0000 UTC m=+47.957449748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s6x2r" (UID: "9f9c30fb-c07a-4566-8f99-7ddb1ee9da13") : configmap "kube-rbac-proxy" not found
Oct 30 21:54:20.352248 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.348781    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-crio-socket\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.352248 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.349118    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-data-volume\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.352248 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:20.349242    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:54:20.352248 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:20.349297    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls podName:9f9c30fb-c07a-4566-8f99-7ddb1ee9da13 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:20.84928015 +0000 UTC m=+47.958222515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s6x2r" (UID: "9f9c30fb-c07a-4566-8f99-7ddb1ee9da13") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:54:20.387192 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.387167    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:20.410964 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.410938    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgnbc\" (UniqueName: \"kubernetes.io/projected/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-api-access-lgnbc\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.625441 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.625413    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:20.665578 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.665557    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/1.log"
Oct 30 21:54:20.665987 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.665971    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/0.log"
Oct 30 21:54:20.666092 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.666009    2575 generic.go:356] "Generic (PLEG): container finished" podID="9d85ad48-ac81-4f99-83d9-9e93db301d40" containerID="84a58a4c2a6c6501b60b6f539751014c4068696cfaee0f1c690ec27b7012fa9c" exitCode=255
Oct 30 21:54:20.666144 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.666101    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9" event={"ID":"9d85ad48-ac81-4f99-83d9-9e93db301d40","Type":"ContainerDied","Data":"84a58a4c2a6c6501b60b6f539751014c4068696cfaee0f1c690ec27b7012fa9c"}
Oct 30 21:54:20.666197 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.666183    2575 scope.go:122] "RemoveContainer" containerID="073ea8dae66c853156937471065a063aaf92f4e0360bd76120e8b02c9bf7cf5c"
Oct 30 21:54:20.666402 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.666383    2575 scope.go:122] "RemoveContainer" containerID="84a58a4c2a6c6501b60b6f539751014c4068696cfaee0f1c690ec27b7012fa9c"
Oct 30 21:54:20.666781 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:20.666750    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-57lx9_openshift-console-operator(9d85ad48-ac81-4f99-83d9-9e93db301d40)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9" podUID="9d85ad48-ac81-4f99-83d9-9e93db301d40"
Oct 30 21:54:20.667920 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.667896    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tr6dv" event={"ID":"c06a3a88-4b60-4045-b794-e54e3d38068c","Type":"ContainerStarted","Data":"a3edc53d1988b09b0fd405267a17c8ff0b3f89aea12a073ecd6d4e820f8f179e"}
Oct 30 21:54:20.669433 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.669413    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rdsd9" event={"ID":"318576c4-97c5-473c-9ea5-4a61c104f89f","Type":"ContainerStarted","Data":"61754ea7687dd59ef9636f34853e2df65b2d47de8311fe6e29f8d9ac724ad654"}
Oct 30 21:54:20.852833 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.852797    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.853019 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.852870    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:20.853019 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:20.852872    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:54:20.853019 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:20.852976    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:54:20.853185 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:20.853031    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm podName:9f9c30fb-c07a-4566-8f99-7ddb1ee9da13 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:21.853010268 +0000 UTC m=+48.961952624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s6x2r" (UID: "9f9c30fb-c07a-4566-8f99-7ddb1ee9da13") : configmap "kube-rbac-proxy" not found
Oct 30 21:54:20.853185 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:20.853051    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls podName:9f9c30fb-c07a-4566-8f99-7ddb1ee9da13 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:21.853041361 +0000 UTC m=+48.961983720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s6x2r" (UID: "9f9c30fb-c07a-4566-8f99-7ddb1ee9da13") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:54:20.892291 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.892220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:20.908727 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:20.908685    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rdsd9" podStartSLOduration=305.401806088 podStartE2EDuration="5m10.90867382s" totalImagesPullingTime="5.506867732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:20.908195424 +0000 UTC m=+48.017137797" watchObservedRunningTime="2026-10-30 21:54:20.90867382 +0000 UTC m=+48.017616193"
Oct 30 21:54:21.032383 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.032328    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-jdpbb"]
Oct 30 21:54:21.033165 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.033128    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tr6dv" podStartSLOduration=3.029343601 podStartE2EDuration="8.033115664s" totalImagesPullingTime="5.003772063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:21.030567766 +0000 UTC m=+48.139510138" watchObservedRunningTime="2026-10-30 21:54:21.033115664 +0000 UTC m=+48.142058061"
Oct 30 21:54:21.034733 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.034719    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-jdpbb"
Oct 30 21:54:21.090191 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.090159    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hfjcw\""
Oct 30 21:54:21.098163 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.098135    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-jdpbb"]
Oct 30 21:54:21.154963 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.154897    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzcwv\" (UniqueName: \"kubernetes.io/projected/e333b33a-d003-4886-83f5-6f1534ca8699-kube-api-access-mzcwv\") pod \"migrator-66df5d496b-jdpbb\" (UID: \"e333b33a-d003-4886-83f5-6f1534ca8699\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-jdpbb"
Oct 30 21:54:21.162529 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.162504    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 21:54:21.162529 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.162504    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 21:54:21.210056 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.210030    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:21.255549 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.255519    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzcwv\" (UniqueName: \"kubernetes.io/projected/e333b33a-d003-4886-83f5-6f1534ca8699-kube-api-access-mzcwv\") pod \"migrator-66df5d496b-jdpbb\" (UID: \"e333b33a-d003-4886-83f5-6f1534ca8699\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-jdpbb"
Oct 30 21:54:21.317756 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.317725    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzcwv\" (UniqueName: \"kubernetes.io/projected/e333b33a-d003-4886-83f5-6f1534ca8699-kube-api-access-mzcwv\") pod \"migrator-66df5d496b-jdpbb\" (UID: \"e333b33a-d003-4886-83f5-6f1534ca8699\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-jdpbb"
Oct 30 21:54:21.345682 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.345658    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-jdpbb"
Oct 30 21:54:21.453238 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.453181    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:21.659935 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.659907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:21.660079 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.659945    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:21.660079 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.659991    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:21.660079 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660063    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:54:21.660079 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660076    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9c975d75-kkjl6: secret "image-registry-tls" not found
Oct 30 21:54:21.660207 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.660095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:21.660207 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660105    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:54:21.660207 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660116    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls podName:cf5df1af-34a5-4168-9f99-b1e8319f6f2b nodeName:}" failed. No retries permitted until 2026-10-30 21:54:29.660104635 +0000 UTC m=+56.769046986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls") pod "image-registry-5b9c975d75-kkjl6" (UID: "cf5df1af-34a5-4168-9f99-b1e8319f6f2b") : secret "image-registry-tls" not found
Oct 30 21:54:21.660207 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.660142    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:21.660207 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660159    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:54:21.660207 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660181    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:54:21.660207 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660064    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:54:21.660207 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660206    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cc778465d-n66s7: secret "image-registry-tls" not found
Oct 30 21:54:21.660466 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660165    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls podName:1f4fae7b-7758-422b-9271-451c4904c76e nodeName:}" failed. No retries permitted until 2026-10-30 21:54:29.660148048 +0000 UTC m=+56.769090401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-qvvd7" (UID: "1f4fae7b-7758-422b-9271-451c4904c76e") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:54:21.660466 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660234    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs podName:fb977621-3d73-4a48-bc4c-a50f67da25d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:29.660227486 +0000 UTC m=+56.769169837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs") pod "router-default-5c6c4f6cbf-rnprt" (UID: "fb977621-3d73-4a48-bc4c-a50f67da25d6") : secret "router-metrics-certs-default" not found
Oct 30 21:54:21.660466 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660248    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls podName:4a4f3ab5-fba1-457f-bd3f-2d760bf6372c nodeName:}" failed. No retries permitted until 2026-10-30 21:54:29.66024363 +0000 UTC m=+56.769185981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls") pod "dns-default-rbmtp" (UID: "4a4f3ab5-fba1-457f-bd3f-2d760bf6372c") : secret "dns-default-metrics-tls" not found
Oct 30 21:54:21.660466 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660259    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls podName:9703e4a3-5da9-4c15-9f8d-2855f39f0808 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:29.660254663 +0000 UTC m=+56.769197014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls") pod "image-registry-5cc778465d-n66s7" (UID: "9703e4a3-5da9-4c15-9f8d-2855f39f0808") : secret "image-registry-tls" not found
Oct 30 21:54:21.660466 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.660270    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:21.660466 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.660312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:21.660466 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.660343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:21.660466 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660387    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle podName:fb977621-3d73-4a48-bc4c-a50f67da25d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:29.660375839 +0000 UTC m=+56.769318195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle") pod "router-default-5c6c4f6cbf-rnprt" (UID: "fb977621-3d73-4a48-bc4c-a50f67da25d6") : configmap references non-existent config key: service-ca.crt
Oct 30 21:54:21.660466 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660396    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:54:21.660466 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660425    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert podName:416a5a6a-c3b4-460e-9382-4ed77d5ca406 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:29.660416591 +0000 UTC m=+56.769358941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-bj87t" (UID: "416a5a6a-c3b4-460e-9382-4ed77d5ca406") : secret "networking-console-plugin-cert" not found
Oct 30 21:54:21.660466 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660444    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:54:21.660811 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.660479    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls podName:6a89d9ac-d62b-42e4-934a-faaa4285277a nodeName:}" failed. No retries permitted until 2026-10-30 21:54:29.660468793 +0000 UTC m=+56.769411174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-t4r5j" (UID: "6a89d9ac-d62b-42e4-934a-faaa4285277a") : secret "samples-operator-tls" not found
Oct 30 21:54:21.674570 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.674549    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/1.log"
Oct 30 21:54:21.674850 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.674836    2575 scope.go:122] "RemoveContainer" containerID="84a58a4c2a6c6501b60b6f539751014c4068696cfaee0f1c690ec27b7012fa9c"
Oct 30 21:54:21.675009 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.674991    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-57lx9_openshift-console-operator(9d85ad48-ac81-4f99-83d9-9e93db301d40)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9" podUID="9d85ad48-ac81-4f99-83d9-9e93db301d40"
Oct 30 21:54:21.684623 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.684585    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:21.719071 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.719014    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-jdpbb"]
Oct 30 21:54:21.722045 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:54:21.722019    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode333b33a_d003_4886_83f5_6f1534ca8699.slice/crio-59292563aa0e42c58ccb74e2987c4b9f7c43aba4e5a5e429b34677e620741a40 WatchSource:0}: Error finding container 59292563aa0e42c58ccb74e2987c4b9f7c43aba4e5a5e429b34677e620741a40: Status 404 returned error can't find the container with id 59292563aa0e42c58ccb74e2987c4b9f7c43aba4e5a5e429b34677e620741a40
Oct 30 21:54:21.862298 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.862265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:21.862489 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.862408    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:54:21.862489 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:21.862442    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:21.862489 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.862465    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm podName:9f9c30fb-c07a-4566-8f99-7ddb1ee9da13 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:23.862450218 +0000 UTC m=+50.971392569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s6x2r" (UID: "9f9c30fb-c07a-4566-8f99-7ddb1ee9da13") : configmap "kube-rbac-proxy" not found
Oct 30 21:54:21.862691 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.862522    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:54:21.862691 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:21.862572    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls podName:9f9c30fb-c07a-4566-8f99-7ddb1ee9da13 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:23.862561483 +0000 UTC m=+50.971503834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s6x2r" (UID: "9f9c30fb-c07a-4566-8f99-7ddb1ee9da13") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:54:22.140875 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:22.140842    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:22.520025 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:22.519953    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:22.679575 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:22.679542    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-jdpbb" event={"ID":"e333b33a-d003-4886-83f5-6f1534ca8699","Type":"ContainerStarted","Data":"59292563aa0e42c58ccb74e2987c4b9f7c43aba4e5a5e429b34677e620741a40"}
Oct 30 21:54:22.802988 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:22.802908    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:23.394168 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:23.394141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:23.684527 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:23.684492    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-jdpbb" event={"ID":"e333b33a-d003-4886-83f5-6f1534ca8699","Type":"ContainerStarted","Data":"9be1e6b53a0a137a1f3ef405bbdca58a1255854e07980ffe64a1184453dc94b0"}
Oct 30 21:54:23.801634 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:23.801574    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-jdpbb" podStartSLOduration=2.276536413 podStartE2EDuration="3.801560153s" totalImagesPullingTime="1.52502374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:23.800130256 +0000 UTC m=+50.909072625" watchObservedRunningTime="2026-10-30 21:54:23.801560153 +0000 UTC m=+50.910502526"
Oct 30 21:54:23.883885 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:23.883850    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:23.884033 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:23.884001    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:54:23.884071 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:23.884065    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls podName:9f9c30fb-c07a-4566-8f99-7ddb1ee9da13 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:27.884049374 +0000 UTC m=+54.992991740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s6x2r" (UID: "9f9c30fb-c07a-4566-8f99-7ddb1ee9da13") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:54:23.884111 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:23.884097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:23.884230 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:23.884217    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:54:23.884276 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:23.884267    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm podName:9f9c30fb-c07a-4566-8f99-7ddb1ee9da13 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:27.884256593 +0000 UTC m=+54.993198943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s6x2r" (UID: "9f9c30fb-c07a-4566-8f99-7ddb1ee9da13") : configmap "kube-rbac-proxy" not found
Oct 30 21:54:24.199300 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:24.199268    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:24.199465 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:24.199318    2575 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:24.199677 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:24.199664    2575 scope.go:122] "RemoveContainer" containerID="84a58a4c2a6c6501b60b6f539751014c4068696cfaee0f1c690ec27b7012fa9c"
Oct 30 21:54:24.199845 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:24.199828    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-57lx9_openshift-console-operator(9d85ad48-ac81-4f99-83d9-9e93db301d40)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9" podUID="9d85ad48-ac81-4f99-83d9-9e93db301d40"
Oct 30 21:54:27.919618 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:27.919566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:27.920062 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:27.919635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:27.920062 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:27.919704    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:54:27.920062 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:27.919743    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:54:27.920062 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:27.919778    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm podName:9f9c30fb-c07a-4566-8f99-7ddb1ee9da13 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:35.919763209 +0000 UTC m=+63.028705559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s6x2r" (UID: "9f9c30fb-c07a-4566-8f99-7ddb1ee9da13") : configmap "kube-rbac-proxy" not found
Oct 30 21:54:27.920062 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:27.919820    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls podName:9f9c30fb-c07a-4566-8f99-7ddb1ee9da13 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:35.919801813 +0000 UTC m=+63.028744181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s6x2r" (UID: "9f9c30fb-c07a-4566-8f99-7ddb1ee9da13") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:54:27.941023 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:27.940997    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:28.729447 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:28.729414    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:29.051279 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:29.051209    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bvgp5_434e8ae7-f2c1-4195-a22e-366bf3290d79/dns-node-resolver/0.log"
Oct 30 21:54:29.389621 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:29.389573    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:29.737641 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:29.737545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls\") pod \"image-registry-5cc778465d-n66s7\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") " pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:29.737641 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:29.737583    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:29.737856 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:29.737654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:29.737856 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:29.737688    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:29.737856 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.737708    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:54:29.737856 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.737726    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cc778465d-n66s7: secret "image-registry-tls" not found
Oct 30 21:54:29.737856 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:29.737725    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:29.737856 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:29.737750    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:29.737856 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.737762    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:54:29.737856 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.737776    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:54:29.737856 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.737795    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9c975d75-kkjl6: secret "image-registry-tls" not found
Oct 30 21:54:29.737856 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.737802    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:54:29.737856 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.737780    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls podName:9703e4a3-5da9-4c15-9f8d-2855f39f0808 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:45.73776346 +0000 UTC m=+72.846705825 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls") pod "image-registry-5cc778465d-n66s7" (UID: "9703e4a3-5da9-4c15-9f8d-2855f39f0808") : secret "image-registry-tls" not found
Oct 30 21:54:29.737856 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.737848    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls podName:1f4fae7b-7758-422b-9271-451c4904c76e nodeName:}" failed. No retries permitted until 2026-10-30 21:54:45.737831246 +0000 UTC m=+72.846773597 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-qvvd7" (UID: "1f4fae7b-7758-422b-9271-451c4904c76e") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:54:29.738321 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.737866    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle podName:fb977621-3d73-4a48-bc4c-a50f67da25d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:45.737856093 +0000 UTC m=+72.846798450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle") pod "router-default-5c6c4f6cbf-rnprt" (UID: "fb977621-3d73-4a48-bc4c-a50f67da25d6") : configmap references non-existent config key: service-ca.crt
Oct 30 21:54:29.738321 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.737885    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls podName:cf5df1af-34a5-4168-9f99-b1e8319f6f2b nodeName:}" failed. No retries permitted until 2026-10-30 21:54:45.737875808 +0000 UTC m=+72.846818170 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls") pod "image-registry-5b9c975d75-kkjl6" (UID: "cf5df1af-34a5-4168-9f99-b1e8319f6f2b") : secret "image-registry-tls" not found
Oct 30 21:54:29.738321 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.737902    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs podName:fb977621-3d73-4a48-bc4c-a50f67da25d6 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:45.737894787 +0000 UTC m=+72.846837138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs") pod "router-default-5c6c4f6cbf-rnprt" (UID: "fb977621-3d73-4a48-bc4c-a50f67da25d6") : secret "router-metrics-certs-default" not found
Oct 30 21:54:29.738321 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:29.737977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:29.738321 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:29.738030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:29.738321 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.738076    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:54:29.738321 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.738113    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls podName:6a89d9ac-d62b-42e4-934a-faaa4285277a nodeName:}" failed. No retries permitted until 2026-10-30 21:54:45.738103967 +0000 UTC m=+72.847046318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-t4r5j" (UID: "6a89d9ac-d62b-42e4-934a-faaa4285277a") : secret "samples-operator-tls" not found
Oct 30 21:54:29.738321 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.738114    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:54:29.738321 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:29.738159    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert podName:416a5a6a-c3b4-460e-9382-4ed77d5ca406 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:45.738144989 +0000 UTC m=+72.847087354 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-bj87t" (UID: "416a5a6a-c3b4-460e-9382-4ed77d5ca406") : secret "networking-console-plugin-cert" not found
Oct 30 21:54:29.740080 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:29.740063    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:29.790032 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:29.790003    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:29.845536 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:29.845511    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:30.267241 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:30.267210    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rbmtp"]
Oct 30 21:54:30.270512 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:54:30.270471    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a4f3ab5_fba1_457f_bd3f_2d760bf6372c.slice/crio-3be84ff88d557ae10b7cb8b434155d557616bf6c549ff6884a46ad0ae1502678 WatchSource:0}: Error finding container 3be84ff88d557ae10b7cb8b434155d557616bf6c549ff6884a46ad0ae1502678: Status 404 returned error can't find the container with id 3be84ff88d557ae10b7cb8b434155d557616bf6c549ff6884a46ad0ae1502678
Oct 30 21:54:30.271237 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:30.271096    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:30.369374 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:30.369349    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p97r6_f63cc71d-ab0b-4137-9cce-a1c780acfb09/node-ca/0.log"
Oct 30 21:54:30.407643 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:30.407621    2575 scope.go:122] "RemoveContainer" containerID="84a58a4c2a6c6501b60b6f539751014c4068696cfaee0f1c690ec27b7012fa9c"
Oct 30 21:54:30.607477 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:30.607451    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:30.708432 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:30.708403    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 21:54:30.708853 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:30.708839    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/1.log"
Oct 30 21:54:30.708905 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:30.708871    2575 generic.go:356] "Generic (PLEG): container finished" podID="9d85ad48-ac81-4f99-83d9-9e93db301d40" containerID="23fcb3fb2dc40787e1e84b1059abcc8262c503e3dc64169257f2b25d4c114dda" exitCode=255
Oct 30 21:54:30.708967 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:30.708948    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9" event={"ID":"9d85ad48-ac81-4f99-83d9-9e93db301d40","Type":"ContainerDied","Data":"23fcb3fb2dc40787e1e84b1059abcc8262c503e3dc64169257f2b25d4c114dda"}
Oct 30 21:54:30.709022 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:30.709008    2575 scope.go:122] "RemoveContainer" containerID="84a58a4c2a6c6501b60b6f539751014c4068696cfaee0f1c690ec27b7012fa9c"
Oct 30 21:54:30.709282 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:30.709263    2575 scope.go:122] "RemoveContainer" containerID="23fcb3fb2dc40787e1e84b1059abcc8262c503e3dc64169257f2b25d4c114dda"
Oct 30 21:54:30.709517 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:30.709496    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-57lx9_openshift-console-operator(9d85ad48-ac81-4f99-83d9-9e93db301d40)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9" podUID="9d85ad48-ac81-4f99-83d9-9e93db301d40"
Oct 30 21:54:30.710113 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:30.710072    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rbmtp" event={"ID":"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c","Type":"ContainerStarted","Data":"3be84ff88d557ae10b7cb8b434155d557616bf6c549ff6884a46ad0ae1502678"}
Oct 30 21:54:30.848497 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:30.848472    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tr6dv_c06a3a88-4b60-4045-b794-e54e3d38068c/serve-healthcheck-canary/0.log"
Oct 30 21:54:30.967978 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:30.967952    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:31.256978 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:31.256905    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-jdpbb_e333b33a-d003-4886-83f5-6f1534ca8699/migrator/0.log"
Oct 30 21:54:31.334356 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:31.334314    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:31.456772 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:31.456733    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9_598df9f3-580f-4014-9abd-a9d84272f7d7/kube-storage-version-migrator-operator/0.log"
Oct 30 21:54:31.673694 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:31.673659    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:31.714865 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:31.714831    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 21:54:32.179909 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:32.179876    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:32.638859 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:32.638827    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:33.029847 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:33.029814    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:33.338928 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:33.338889    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:33.685839 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:33.685756    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:33.723336 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:33.723307    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rbmtp" event={"ID":"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c","Type":"ContainerStarted","Data":"750f054af7593562e916f0a4151383f67bcbe6030030bed15791de175713a77d"}
Oct 30 21:54:33.723476 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:33.723357    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rbmtp" event={"ID":"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c","Type":"ContainerStarted","Data":"9b8dd4e0e62e0e8403ae5574290577a86a20385e8ec2a0278178a0ebab8640ac"}
Oct 30 21:54:33.723532 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:33.723467    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:33.895491 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:33.895440    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-rbmtp" podStartSLOduration=18.425075488 podStartE2EDuration="20.895426595s" totalImagesPullingTime="2.470351107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:33.894818745 +0000 UTC m=+61.003761119" watchObservedRunningTime="2026-10-30 21:54:33.895426595 +0000 UTC m=+61.004368967"
Oct 30 21:54:34.199497 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:34.199465    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:34.199684 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:34.199538    2575 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:34.199859 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:34.199846    2575 scope.go:122] "RemoveContainer" containerID="23fcb3fb2dc40787e1e84b1059abcc8262c503e3dc64169257f2b25d4c114dda"
Oct 30 21:54:34.200019 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:34.200002    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-57lx9_openshift-console-operator(9d85ad48-ac81-4f99-83d9-9e93db301d40)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9" podUID="9d85ad48-ac81-4f99-83d9-9e93db301d40"
Oct 30 21:54:34.253701 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:34.253668    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:34.561578 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:34.561546    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:34.819800 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:34.819727    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:35.076035 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:35.075954    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:35.334264 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:35.334175    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:35.996897 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:35.996863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:35.997259 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:35.996918    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:35.997259 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:35.997091    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:54:35.997259 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:35.997175    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls podName:9f9c30fb-c07a-4566-8f99-7ddb1ee9da13 nodeName:}" failed. No retries permitted until 2026-10-30 21:54:51.997153139 +0000 UTC m=+79.106095508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s6x2r" (UID: "9f9c30fb-c07a-4566-8f99-7ddb1ee9da13") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:54:35.997473 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:35.997453    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:36.151771 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:36.151738    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:36.515888 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:36.515855    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:37.908410 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:37.908378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:38.181571 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.181490    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:38.315832 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.315802    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:38.315977 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.315888    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:38.414871 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.414835    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:38.416005 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.415988    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:54:38.416063 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.416026    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:54:38.416281 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.416265    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk6wz\" (UniqueName: \"kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz\") pod \"network-check-target-6gnzt\" (UID: \"4110027a-d96e-4b82-8206-3f4c30cc5978\") " pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:38.418227 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.418201    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:38.418545 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.418530    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk6wz\" (UniqueName: \"kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz\") pod \"network-check-target-6gnzt\" (UID: \"4110027a-d96e-4b82-8206-3f4c30cc5978\") " pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:38.427964 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.427942    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:38.574768 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.574747    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-fd64m\""
Oct 30 21:54:38.580199 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.580183    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-c7qtj\""
Oct 30 21:54:38.584309 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.584288    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:38.584810 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.584795    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:38.589464 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.589450    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:38.649252 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.649050    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:38.769503 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.769475    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-66njg\""
Oct 30 21:54:38.779078 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.779055    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:38.965880 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.965847    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:38.972199 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:38.972172    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6gnzt"]
Oct 30 21:54:38.975699 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:54:38.975677    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4110027a_d96e_4b82_8206_3f4c30cc5978.slice/crio-3fcb5c993a40dacc25eab0708eb13749ddd105f655f6d4be3add380338492011 WatchSource:0}: Error finding container 3fcb5c993a40dacc25eab0708eb13749ddd105f655f6d4be3add380338492011: Status 404 returned error can't find the container with id 3fcb5c993a40dacc25eab0708eb13749ddd105f655f6d4be3add380338492011
Oct 30 21:54:39.024648 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:39.024628    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2hjmh"]
Oct 30 21:54:39.026707 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:54:39.026685    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5981da65_938a_4058_b3cb_459025feb5d6.slice/crio-2633f368240fc088f6c7cc93569abe8a4a726c296461b014671b97787b7c87f0 WatchSource:0}: Error finding container 2633f368240fc088f6c7cc93569abe8a4a726c296461b014671b97787b7c87f0: Status 404 returned error can't find the container with id 2633f368240fc088f6c7cc93569abe8a4a726c296461b014671b97787b7c87f0
Oct 30 21:54:39.158730 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:39.158665    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xpf4w"]
Oct 30 21:54:39.161415 ip-10-0-137-32 kubenswrapper[2575]: W1030 21:54:39.161384    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a5aacf3_197a_4725_b9ae_a0d0f11888e7.slice/crio-259a3710afcfbd1e3b4c0ad29ad45bb58457c4decd63ec1597325e04df40d5df WatchSource:0}: Error finding container 259a3710afcfbd1e3b4c0ad29ad45bb58457c4decd63ec1597325e04df40d5df: Status 404 returned error can't find the container with id 259a3710afcfbd1e3b4c0ad29ad45bb58457c4decd63ec1597325e04df40d5df
Oct 30 21:54:39.207246 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:39.207218    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:39.428695 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:39.428617    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:39.661447 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:39.661417    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:39.744308 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:39.744231    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6gnzt" event={"ID":"4110027a-d96e-4b82-8206-3f4c30cc5978","Type":"ContainerStarted","Data":"7aeaa3618975f9186b8506436f79af7617f50105ea52efd4d9b4f49fd5293be2"}
Oct 30 21:54:39.744308 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:39.744283    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6gnzt" event={"ID":"4110027a-d96e-4b82-8206-3f4c30cc5978","Type":"ContainerStarted","Data":"3fcb5c993a40dacc25eab0708eb13749ddd105f655f6d4be3add380338492011"}
Oct 30 21:54:39.744491 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:39.744331    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:39.745386 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:39.745357    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2hjmh" event={"ID":"5981da65-938a-4058-b3cb-459025feb5d6","Type":"ContainerStarted","Data":"2633f368240fc088f6c7cc93569abe8a4a726c296461b014671b97787b7c87f0"}
Oct 30 21:54:39.746472 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:39.746452    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xpf4w" event={"ID":"1a5aacf3-197a-4725-b9ae-a0d0f11888e7","Type":"ContainerStarted","Data":"259a3710afcfbd1e3b4c0ad29ad45bb58457c4decd63ec1597325e04df40d5df"}
Oct 30 21:54:39.861021 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:39.860978    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6gnzt" podStartSLOduration=66.860966099 podStartE2EDuration="1m6.860966099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:39.860806477 +0000 UTC m=+66.969748841" watchObservedRunningTime="2026-10-30 21:54:39.860966099 +0000 UTC m=+66.969908472"
Oct 30 21:54:39.902713 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:39.902689    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:41.754726 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:41.754685    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xpf4w" event={"ID":"1a5aacf3-197a-4725-b9ae-a0d0f11888e7","Type":"ContainerStarted","Data":"52073be7dd3e59d4cb2573acfc2670a0fe1eb3b25a009001abf71c2e8c0d6a7d"}
Oct 30 21:54:41.755117 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:41.754752    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xpf4w" event={"ID":"1a5aacf3-197a-4725-b9ae-a0d0f11888e7","Type":"ContainerStarted","Data":"a9dfd5041c4f7441e79df5d78e0ef882a16812b78c091fd4d760aaa77cf3f254"}
Oct 30 21:54:41.871610 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:41.871529    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xpf4w" podStartSLOduration=66.994434815 podStartE2EDuration="1m8.871512716s" totalImagesPullingTime="1.877077901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:41.870919992 +0000 UTC m=+68.979862367" watchObservedRunningTime="2026-10-30 21:54:41.871512716 +0000 UTC m=+68.980455091"
Oct 30 21:54:42.572325 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:42.572288    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:42.820084 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:42.820045    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:43.359153 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.359117    2575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cc778465d-n66s7"]
Oct 30 21:54:43.359348 ip-10-0-137-32 kubenswrapper[2575]: E1030 21:54:43.359313    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5cc778465d-n66s7" podUID="9703e4a3-5da9-4c15-9f8d-2855f39f0808"
Oct 30 21:54:43.642766 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.642677    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:43.729445 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.729414    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:43.761147 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.761116    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:43.767105 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.767082    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:43.877822 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.877791    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9703e4a3-5da9-4c15-9f8d-2855f39f0808-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9703e4a3-5da9-4c15-9f8d-2855f39f0808-ca-trust-extracted\") pod \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") "
Oct 30 21:54:43.878293 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.877838    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-bound-sa-token\") pod \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") "
Oct 30 21:54:43.878293 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.877876    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-certificates\") pod \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") "
Oct 30 21:54:43.878293 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.877900    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-kube-api-access-qrxfk\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-kube-api-access-qrxfk\") pod \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") "
Oct 30 21:54:43.878293 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.877939    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9703e4a3-5da9-4c15-9f8d-2855f39f0808-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9703e4a3-5da9-4c15-9f8d-2855f39f0808-image-registry-private-configuration\") pod \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") "
Oct 30 21:54:43.878293 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.877970    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9703e4a3-5da9-4c15-9f8d-2855f39f0808-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9703e4a3-5da9-4c15-9f8d-2855f39f0808-trusted-ca\") pod \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") "
Oct 30 21:54:43.878293 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.877995    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9703e4a3-5da9-4c15-9f8d-2855f39f0808-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9703e4a3-5da9-4c15-9f8d-2855f39f0808-installation-pull-secrets\") pod \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\" (UID: \"9703e4a3-5da9-4c15-9f8d-2855f39f0808\") "
Oct 30 21:54:43.879351 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.878792    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9703e4a3-5da9-4c15-9f8d-2855f39f0808-trusted-ca" pod "9703e4a3-5da9-4c15-9f8d-2855f39f0808" (UID: "9703e4a3-5da9-4c15-9f8d-2855f39f0808"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:54:43.879351 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.878884    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9703e4a3-5da9-4c15-9f8d-2855f39f0808-ca-trust-extracted" pod "9703e4a3-5da9-4c15-9f8d-2855f39f0808" (UID: "9703e4a3-5da9-4c15-9f8d-2855f39f0808"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:43.879351 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.878920    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-certificates" pod "9703e4a3-5da9-4c15-9f8d-2855f39f0808" (UID: "9703e4a3-5da9-4c15-9f8d-2855f39f0808"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:54:43.881090 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.881059    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9703e4a3-5da9-4c15-9f8d-2855f39f0808-image-registry-private-configuration" pod "9703e4a3-5da9-4c15-9f8d-2855f39f0808" (UID: "9703e4a3-5da9-4c15-9f8d-2855f39f0808"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:54:43.881417 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.881390    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9703e4a3-5da9-4c15-9f8d-2855f39f0808-installation-pull-secrets" pod "9703e4a3-5da9-4c15-9f8d-2855f39f0808" (UID: "9703e4a3-5da9-4c15-9f8d-2855f39f0808"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:54:43.881563 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.881536    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-kube-api-access-qrxfk" pod "9703e4a3-5da9-4c15-9f8d-2855f39f0808" (UID: "9703e4a3-5da9-4c15-9f8d-2855f39f0808"). InnerVolumeSpecName "kube-api-access-qrxfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:43.881852 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.881814    2575 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-bound-sa-token" pod "9703e4a3-5da9-4c15-9f8d-2855f39f0808" (UID: "9703e4a3-5da9-4c15-9f8d-2855f39f0808"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:43.937118 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.937040    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:43.978896 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.978867    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9703e4a3-5da9-4c15-9f8d-2855f39f0808-trusted-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:43.979137 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.978900    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9703e4a3-5da9-4c15-9f8d-2855f39f0808-installation-pull-secrets\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:43.979137 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.978938    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9703e4a3-5da9-4c15-9f8d-2855f39f0808-ca-trust-extracted\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:43.979137 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.978952    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-bound-sa-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:43.979137 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.978965    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-certificates\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:43.979137 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.978979    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrxfk\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-kube-api-access-qrxfk\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:43.979137 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:43.978993    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9703e4a3-5da9-4c15-9f8d-2855f39f0808-image-registry-private-configuration\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:44.164379 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:44.164337    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:44.393668 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:44.393636    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:44.765455 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:44.765375    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cc778465d-n66s7"
Oct 30 21:54:45.049916 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:45.049891    2575 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cc778465d-n66s7"]
Oct 30 21:54:45.052366 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:45.052345    2575 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cc778465d-n66s7"]
Oct 30 21:54:45.191640 ip-10-0-137-32 kubenswrapper[2575]: I1030 21:54:45.191605    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9703e4a3-5da9-4c15-9f8d-2855f39f0808-registry-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:45.207869 ip-10-0-137-32 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 21:54:45.225986 ip-10-0-137-32 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 21:54:45.226153 ip-10-0-137-32 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 21:54:45.226330 ip-10-0-137-32 systemd[1]: kubelet.service: Consumed 4.086s CPU time.
Oct 30 21:54:45.239404 ip-10-0-137-32 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 21:54:45.300928 ip-10-0-137-32 kubenswrapper[5258]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:54:45.300928 ip-10-0-137-32 kubenswrapper[5258]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 21:54:45.300928 ip-10-0-137-32 kubenswrapper[5258]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:54:45.300928 ip-10-0-137-32 kubenswrapper[5258]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:54:45.302850 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302774    5258 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:54:45.302850 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302850    5258 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302854    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302858    5258 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302861    5258 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302864    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302867    5258 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302870    5258 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302872    5258 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302876    5258 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302878    5258 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302881    5258 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302884    5258 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302886    5258 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302889    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302891    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302894    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302897    5258 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302900    5258 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302902    5258 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302905    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:54:45.302932 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302908    5258 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302910    5258 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302913    5258 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302916    5258 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302918    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302921    5258 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302928    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302931    5258 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302935    5258 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302940    5258 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302943    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302950    5258 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302953    5258 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302956    5258 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302958    5258 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302961    5258 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302963    5258 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302966    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302968    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:54:45.303421 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302971    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302974    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302976    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302979    5258 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302982    5258 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302985    5258 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302988    5258 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302990    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302993    5258 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302996    5258 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.302998    5258 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303001    5258 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303003    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303006    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303009    5258 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303012    5258 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303015    5258 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303018    5258 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303021    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303024    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:54:45.303917 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303026    5258 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303029    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303031    5258 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303034    5258 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303037    5258 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303039    5258 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303042    5258 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303044    5258 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303047    5258 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303049    5258 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303052    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303057    5258 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303061    5258 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303064    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303067    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303069    5258 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303072    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303075    5258 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303078    5258 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:54:45.304419 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303080    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303083    5258 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303085    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303088    5258 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303091    5258 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303093    5258 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303096    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303099    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303102    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303109    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303111    5258 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303114    5258 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303116    5258 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303119    5258 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303122    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303124    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303127    5258 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303130    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303132    5258 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:54:45.304898 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303135    5258 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303137    5258 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303140    5258 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303142    5258 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303146    5258 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303149    5258 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303151    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303154    5258 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303956    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303963    5258 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303966    5258 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303969    5258 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303972    5258 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303975    5258 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303977    5258 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303980    5258 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303983    5258 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303985    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303989    5258 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303991    5258 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:54:45.305385 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303994    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.303998    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304001    5258 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304003    5258 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304006    5258 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304009    5258 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304011    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304014    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304016    5258 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304019    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304021    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304024    5258 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304026    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304029    5258 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304032    5258 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304034    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304037    5258 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304040    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304042    5258 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:54:45.305957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304045    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304048    5258 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304050    5258 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304053    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304055    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304058    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304061    5258 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304063    5258 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304066    5258 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304069    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304072    5258 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304074    5258 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304077    5258 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304081    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304083    5258 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304086    5258 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304089    5258 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304092    5258 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304095    5258 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:54:45.306447 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304097    5258 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304100    5258 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304102    5258 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304105    5258 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304107    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304110    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304112    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304115    5258 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304117    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304120    5258 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304123    5258 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304125    5258 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304128    5258 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304131    5258 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304133    5258 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304136    5258 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304138    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304141    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304143    5258 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:54:45.306944 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304147    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304149    5258 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304152    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304155    5258 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304157    5258 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304160    5258 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304162    5258 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304165    5258 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304168    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304170    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304173    5258 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304175    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304178    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304181    5258 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304183    5258 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304186    5258 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304188    5258 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304191    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304195    5258 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304199    5258 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:54:45.307432 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304201    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304204    5258 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304207    5258 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304209    5258 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304212    5258 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304215    5258 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304218    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304220    5258 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304225    5258 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304228    5258 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304231    5258 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304234    5258 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304236    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304239    5258 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304242    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304245    5258 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304247    5258 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304733    5258 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304739    5258 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304742    5258 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:54:45.307957 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304745    5258 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304747    5258 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304750    5258 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304753    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304756    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304758    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304761    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304764    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304768    5258 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304770    5258 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304773    5258 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304775    5258 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304778    5258 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304783    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304786    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304789    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304791    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304795    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304798    5258 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304800    5258 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:54:45.308469 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304803    5258 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304806    5258 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304808    5258 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304811    5258 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304813    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304817    5258 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304820    5258 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304822    5258 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304825    5258 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304827    5258 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304830    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304834    5258 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304838    5258 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304840    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304844    5258 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304846    5258 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304849    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304851    5258 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304854    5258 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:54:45.308974 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304859    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304861    5258 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304864    5258 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304867    5258 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304870    5258 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304872    5258 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304876    5258 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304879    5258 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304881    5258 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304884    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304886    5258 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304889    5258 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304892    5258 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304895    5258 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304898    5258 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304900    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304903    5258 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304906    5258 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304909    5258 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:54:45.309440 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304913    5258 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304917    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304920    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304923    5258 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304925    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304928    5258 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304931    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304933    5258 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304936    5258 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304938    5258 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304941    5258 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304943    5258 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304946    5258 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304953    5258 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304955    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304958    5258 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304960    5258 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304963    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304966    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304969    5258 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:54:45.309930 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304972    5258 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304975    5258 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304977    5258 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304980    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304983    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304985    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304988    5258 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304990    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304993    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304996    5258 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.304998    5258 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305001    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305003    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305008    5258 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305010    5258 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305013    5258 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305016    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305018    5258 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305021    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:54:45.310424 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305023    5258 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305026    5258 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305028    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305031    5258 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305033    5258 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305036    5258 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305138    5258 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305148    5258 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305157    5258 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305164    5258 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305168    5258 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305172    5258 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305179    5258 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305183    5258 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305186    5258 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305189    5258 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305193    5258 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305196    5258 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305199    5258 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305202    5258 flags.go:64] FLAG: --cgroup-root=""
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305205    5258 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305208    5258 flags.go:64] FLAG: --client-ca-file=""
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305211    5258 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 21:54:45.311083 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305214    5258 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305218    5258 flags.go:64] FLAG: --cluster-domain=""
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305221    5258 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305224    5258 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305228    5258 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305231    5258 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305236    5258 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305239    5258 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305242    5258 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305246    5258 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305249    5258 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305252    5258 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305255    5258 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305258    5258 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305261    5258 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305267    5258 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305270    5258 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305273    5258 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305276    5258 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305279    5258 flags.go:64] FLAG: --enable-server="true"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305282    5258 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305287    5258 flags.go:64] FLAG: --event-burst="100"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305290    5258 flags.go:64] FLAG: --event-qps="50"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305294    5258 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 21:54:45.311766 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305297    5258 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305300    5258 flags.go:64] FLAG: --eviction-hard=""
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305304    5258 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305307    5258 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305310    5258 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305313    5258 flags.go:64] FLAG: --eviction-soft=""
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305316    5258 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305319    5258 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305322    5258 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305325    5258 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305328    5258 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305331    5258 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305334    5258 flags.go:64] FLAG: --feature-gates=""
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305338    5258 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305341    5258 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305344    5258 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305347    5258 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305351    5258 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305354    5258 flags.go:64] FLAG: --help="false"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305357    5258 flags.go:64] FLAG: --hostname-override="ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305360    5258 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305363    5258 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305366    5258 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 21:54:45.312657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305371    5258 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305374    5258 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305377    5258 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305380    5258 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305383    5258 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305386    5258 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305390    5258 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305394    5258 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305396    5258 flags.go:64] FLAG: --kube-reserved=""
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305400    5258 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305403    5258 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305406    5258 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305408    5258 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305411    5258 flags.go:64] FLAG: --lock-file=""
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305414    5258 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305417    5258 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305420    5258 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305426    5258 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305429    5258 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305432    5258 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305435    5258 flags.go:64] FLAG: --logging-format="text"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305438    5258 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305441    5258 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305445    5258 flags.go:64] FLAG: --manifest-url=""
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305448    5258 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 21:54:45.313225 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305452    5258 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305455    5258 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305459    5258 flags.go:64] FLAG: --max-pods="110"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305462    5258 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305465    5258 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305468    5258 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305471    5258 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305475    5258 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305478    5258 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305481    5258 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305487    5258 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305490    5258 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305534    5258 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305540    5258 flags.go:64] FLAG: --pod-cidr=""
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305543    5258 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305546    5258 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305549    5258 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305552    5258 flags.go:64] FLAG: --port="10250"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305555    5258 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305558    5258 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0b947b003c19ca0f0"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305561    5258 flags.go:64] FLAG: --qos-reserved=""
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305564    5258 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305567    5258 flags.go:64] FLAG: --register-node="true"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305570    5258 flags.go:64] FLAG: --register-with-taints=""
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305574    5258 flags.go:64] FLAG: --registry-burst="10"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305577    5258 flags.go:64] FLAG: --registry-qps="5"
Oct 30 21:54:45.313892 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305580    5258 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305583    5258 flags.go:64] FLAG: --reserved-memory=""
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305599    5258 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305603    5258 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305606    5258 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305609    5258 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305612    5258 flags.go:64] FLAG: --runonce="false"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305615    5258 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305618    5258 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305621    5258 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305624    5258 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305627    5258 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305630    5258 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305633    5258 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305636    5258 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305641    5258 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305645    5258 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305650    5258 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305654    5258 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305661    5258 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305665    5258 flags.go:64] FLAG: --system-cgroups=""
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305668    5258 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305673    5258 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305676    5258 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305679    5258 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 21:54:45.314524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305684    5258 flags.go:64] FLAG: --tls-min-version=""
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305687    5258 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305690    5258 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305693    5258 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305696    5258 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305699    5258 flags.go:64] FLAG: --v="2"
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305704    5258 flags.go:64] FLAG: --version="false"
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305708    5258 flags.go:64] FLAG: --vmodule=""
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305712    5258 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.305716    5258 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305859    5258 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305864    5258 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305867    5258 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305870    5258 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305873    5258 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305875    5258 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305878    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305882    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305886    5258 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305891    5258 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305895    5258 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305900    5258 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:54:45.315289 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305903    5258 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305905    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305908    5258 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305911    5258 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305915    5258 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305918    5258 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305921    5258 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305923    5258 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305926    5258 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305929    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305931    5258 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305934    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305937    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305939    5258 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305942    5258 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305944    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305947    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305949    5258 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305952    5258 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305955    5258 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:54:45.316120 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305957    5258 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305961    5258 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305974    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305979    5258 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305984    5258 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305987    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305990    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305992    5258 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305995    5258 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.305998    5258 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306000    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306003    5258 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306005    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306008    5258 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306011    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306013    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306017    5258 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306021    5258 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306027    5258 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:54:45.316715 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306030    5258 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306032    5258 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306035    5258 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306038    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306040    5258 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306043    5258 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306046    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306051    5258 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306055    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306060    5258 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306065    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306067    5258 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306070    5258 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306072    5258 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306075    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306078    5258 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306082    5258 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306086    5258 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306089    5258 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:54:45.317205 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306092    5258 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306095    5258 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306097    5258 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306100    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306103    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306105    5258 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306107    5258 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306110    5258 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306112    5258 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306115    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306118    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306120    5258 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306125    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306129    5258 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306133    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306138    5258 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306142    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306146    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306149    5258 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:54:45.317729 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306151    5258 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306154    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306156    5258 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306159    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306161    5258 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306164    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306166    5258 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306169    5258 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306171    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306174    5258 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306177    5258 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306180    5258 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306182    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306185    5258 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306188    5258 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306191    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:54:45.318338 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306193    5258 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.306221    5258 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306255    5258 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306260    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306263    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306267    5258 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306270    5258 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306274    5258 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306276    5258 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306280    5258 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306283    5258 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306286    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306289    5258 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306291    5258 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306294    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306297    5258 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:54:45.318785 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306299    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306301    5258 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306304    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306307    5258 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306309    5258 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306312    5258 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306314    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306317    5258 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306321    5258 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306325    5258 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306328    5258 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306331    5258 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306333    5258 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306336    5258 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306339    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306342    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306344    5258 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306347    5258 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306349    5258 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:54:45.319222 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306352    5258 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306354    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306357    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306359    5258 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306363    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306365    5258 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306370    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306373    5258 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306376    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306378    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306381    5258 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306384    5258 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306386    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306389    5258 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306391    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306394    5258 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306396    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306399    5258 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306401    5258 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:54:45.319702 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306404    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306407    5258 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306409    5258 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306412    5258 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306414    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306417    5258 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306419    5258 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306422    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306425    5258 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306428    5258 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306430    5258 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306433    5258 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306435    5258 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306438    5258 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306440    5258 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306443    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306445    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306448    5258 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306451    5258 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306456    5258 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:54:45.320159 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306459    5258 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306461    5258 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306464    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306467    5258 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306469    5258 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306472    5258 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306475    5258 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306477    5258 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306480    5258 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306482    5258 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306485    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306487    5258 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306490    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306493    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306495    5258 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306498    5258 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306500    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306503    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306505    5258 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306508    5258 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:54:45.320828 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306511    5258 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306513    5258 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306516    5258 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306519    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306522    5258 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306525    5258 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306527    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306530    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306532    5258 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306535    5258 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306537    5258 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306542    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306545    5258 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.306547    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.309927    5258 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.309942    5258 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.309961    5258 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.309977    5258 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310030    5258 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310036    5258 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:54:45.321347 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310040    5258 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310043    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310046    5258 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310050    5258 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310053    5258 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310055    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310058    5258 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310062    5258 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310066    5258 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310070    5258 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310073    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310075    5258 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310079    5258 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310083    5258 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310088    5258 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310092    5258 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310095    5258 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310098    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310101    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:54:45.321927 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310104    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310106    5258 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310109    5258 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310112    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310115    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310118    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310120    5258 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310123    5258 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310126    5258 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310129    5258 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310131    5258 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310134    5258 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310137    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310140    5258 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310143    5258 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310146    5258 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310149    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310152    5258 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310155    5258 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310158    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:54:45.322415 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310160    5258 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310163    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310166    5258 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310168    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310171    5258 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310174    5258 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310176    5258 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310179    5258 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310182    5258 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310185    5258 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310188    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310191    5258 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310193    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310196    5258 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310199    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310201    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310204    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310207    5258 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310210    5258 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:54:45.322934 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310212    5258 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310215    5258 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310218    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310220    5258 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310223    5258 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310226    5258 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310228    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310231    5258 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310233    5258 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310236    5258 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310239    5258 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310241    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310244    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310247    5258 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310249    5258 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310252    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310254    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310257    5258 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310259    5258 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310262    5258 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:54:45.323456 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310264    5258 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310267    5258 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310270    5258 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310273    5258 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310276    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310279    5258 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310282    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310284    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310287    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310290    5258 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310293    5258 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310296    5258 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310299    5258 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310301    5258 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310304    5258 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310306    5258 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310309    5258 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310311    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310314    5258 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:54:45.324070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310316    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310319    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310322    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310324    5258 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310327    5258 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310329    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310332    5258 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.310359    5258 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310485    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310490    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310494    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310497    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310501    5258 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310503    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310506    5258 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:54:45.324725 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310508    5258 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310512    5258 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310515    5258 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310517    5258 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310520    5258 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310522    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310525    5258 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310528    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310531    5258 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310533    5258 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310536    5258 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310538    5258 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310541    5258 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310543    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310546    5258 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310549    5258 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310551    5258 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310554    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310557    5258 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310559    5258 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:54:45.325215 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310562    5258 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310565    5258 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310568    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310571    5258 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310574    5258 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310576    5258 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310579    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310581    5258 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310584    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310604    5258 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310607    5258 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310610    5258 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310612    5258 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310616    5258 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310619    5258 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310622    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310624    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310627    5258 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310630    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310632    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:54:45.326025 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310635    5258 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310637    5258 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310640    5258 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310642    5258 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310645    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310647    5258 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310651    5258 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310654    5258 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310657    5258 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310660    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310662    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310665    5258 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310667    5258 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310670    5258 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310673    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310675    5258 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310678    5258 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310680    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310683    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:54:45.326735 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310686    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310689    5258 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310691    5258 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310694    5258 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310696    5258 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310699    5258 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310702    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310704    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310707    5258 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310710    5258 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310712    5258 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310715    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310718    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310720    5258 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310723    5258 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310725    5258 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310728    5258 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310730    5258 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310733    5258 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310736    5258 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:54:45.327351 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310738    5258 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310741    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310743    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310747    5258 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310751    5258 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310754    5258 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310757    5258 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310763    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310765    5258 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310768    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310770    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310773    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310776    5258 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310778    5258 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310781    5258 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310783    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310786    5258 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310789    5258 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310792    5258 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:54:45.327910 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310795    5258 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.310818    5258 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310849    5258 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310853    5258 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310856    5258 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310859    5258 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310862    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310865    5258 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310868    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310870    5258 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310873    5258 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310875    5258 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310878    5258 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310881    5258 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310883    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310886    5258 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:54:45.328383 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310889    5258 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310891    5258 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310894    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310896    5258 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310898    5258 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310902    5258 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310905    5258 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310908    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310910    5258 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310913    5258 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310916    5258 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310918    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310921    5258 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310923    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310926    5258 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310929    5258 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310931    5258 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310934    5258 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310937    5258 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310940    5258 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:54:45.329001 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310943    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310946    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310948    5258 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310951    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310953    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310956    5258 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310958    5258 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310960    5258 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310963    5258 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310965    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310968    5258 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310972    5258 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310975    5258 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310978    5258 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310983    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310986    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310989    5258 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310993    5258 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310996    5258 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:54:45.329747 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.310998    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311001    5258 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311004    5258 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311006    5258 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311009    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311012    5258 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311015    5258 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311017    5258 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311020    5258 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311023    5258 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311025    5258 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311028    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311031    5258 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311034    5258 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311036    5258 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311039    5258 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311042    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311044    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311047    5258 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311049    5258 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:54:45.330258 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311052    5258 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311055    5258 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311057    5258 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311060    5258 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311062    5258 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311065    5258 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311067    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311071    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311075    5258 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311078    5258 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311082    5258 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311085    5258 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311088    5258 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311091    5258 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311094    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311097    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311100    5258 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311102    5258 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311105    5258 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:54:45.330869 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311108    5258 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311110    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311112    5258 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311115    5258 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311118    5258 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311120    5258 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311123    5258 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311126    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311128    5258 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311131    5258 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311134    5258 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311137    5258 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311140    5258 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:45.311142    5258 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.311188    5258 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.313160    5258 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.313215    5258 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.313424    5258 server.go:1014] "Starting client certificate rotation"
Oct 30 21:54:45.331422 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.313561    5258 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:54:45.331922 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.313622    5258 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:48:33 +0000 UTC" deadline="2028-04-17 11:20:37.774605789 +0000 UTC"
Oct 30 21:54:45.331922 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.313651    5258 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12829h25m52.46095688s"
Oct 30 21:54:45.331922 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.313861    5258 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:54:45.331922 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.314952    5258 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:54:45.331922 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.316268    5258 log.go:25] "Validated CRI v1 runtime API"
Oct 30 21:54:45.331922 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.317925    5258 log.go:25] "Validated CRI v1 image API"
Oct 30 21:54:45.331922 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.318614    5258 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 21:54:45.331922 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.320453    5258 fs.go:135] Filesystem UUIDs: map[6db16b9e-f173-4bb0-a5ec-ed679786b0d5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b84158c4-0e7a-459b-b306-22737c3db4d8:/dev/nvme0n1p3]
Oct 30 21:54:45.332293 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.320472    5258 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1d3c640addc230d325287ec9275c058fad82f7b59b87cb31e51a51e8fb780bf6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1d3c640addc230d325287ec9275c058fad82f7b59b87cb31e51a51e8fb780bf6/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/259a3710afcfbd1e3b4c0ad29ad45bb58457c4decd63ec1597325e04df40d5df/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/259a3710afcfbd1e3b4c0ad29ad45bb58457c4decd63ec1597325e04df40d5df/userdata/shm major:0 minor:357 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2633f368240fc088f6c7cc93569abe8a4a726c296461b014671b97787b7c87f0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2633f368240fc088f6c7cc93569abe8a4a726c296461b014671b97787b7c87f0/userdata/shm major:0 minor:355 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/31a2913cd0368886be5d3e71f810e02ad3e68ad8fe848291bf445fa71520caf5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/31a2913cd0368886be5d3e71f810e02ad3e68ad8fe848291bf445fa71520caf5/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/31e597c29ce3c5cd37781eb757bcbb836f60c0c35f8175a9de055213830f94c5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/31e597c29ce3c5cd37781eb757bcbb836f60c0c35f8175a9de055213830f94c5/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3be84ff88d557ae10b7cb8b434155d557616bf6c549ff6884a46ad0ae1502678/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3be84ff88d557ae10b7cb8b434155d557616bf6c549ff6884a46ad0ae1502678/userdata/shm major:0 minor:335 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3c2fe745fe055b7d4992fa9be354e37bd65d79a27fe39dadbd4b30e68d6bd167/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3c2fe745fe055b7d4992fa9be354e37bd65d79a27fe39dadbd4b30e68d6bd167/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3c842eda0020037a73db90bf1983dbdbfb7bd86c94bf1703b54a1aa69bdc9df6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3c842eda0020037a73db90bf1983dbdbfb7bd86c94bf1703b54a1aa69bdc9df6/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3f3f05e46b1874d6a32d6e1a7043cd9240cf260cf8f6501b7e634201e10abcb5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3f3f05e46b1874d6a32d6e1a7043cd9240cf260cf8f6501b7e634201e10abcb5/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3fcb5c993a40dacc25eab0708eb13749ddd105f655f6d4be3add380338492011/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3fcb5c993a40dacc25eab0708eb13749ddd105f655f6d4be3add380338492011/userdata/shm major:0 minor:353 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5096ecdc5fc157feab59a8eeb6452be018b66c80e9aaa1b4d9b2a9019b81aa49/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5096ecdc5fc157feab59a8eeb6452be018b66c80e9aaa1b4d9b2a9019b81aa49/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/511b57184e1dc4b98fdb1a27ded2834c8db4fb0b76899da2455479a7a8c7844b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/511b57184e1dc4b98fdb1a27ded2834c8db4fb0b76899da2455479a7a8c7844b/userdata/shm major:0 minor:243 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/59292563aa0e42c58ccb74e2987c4b9f7c43aba4e5a5e429b34677e620741a40/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/59292563aa0e42c58ccb74e2987c4b9f7c43aba4e5a5e429b34677e620741a40/userdata/shm major:0 minor:324 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/685a63a047a0a56db4b88892d89d1078fc3f10f05eeca1d9612b0f3ea9e4c325/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/685a63a047a0a56db4b88892d89d1078fc3f10f05eeca1d9612b0f3ea9e4c325/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7b904dda6f90486dc5b247fdd4ccd97b44f0a0186a6183f0f8b8012d83adb62e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7b904dda6f90486dc5b247fdd4ccd97b44f0a0186a6183f0f8b8012d83adb62e/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/883fe27eaca3383b6a88a576d027d343f5697e16249acc5f1d4e49f47a6f9d32/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/883fe27eaca3383b6a88a576d027d343f5697e16249acc5f1d4e49f47a6f9d32/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/936d57274e8af87aeb6f7ab5da7fc1aaea17ec0aa42dc7f2a20fcc36d592983e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/936d57274e8af87aeb6f7ab5da7fc1aaea17ec0aa42dc7f2a20fcc36d592983e/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9ff3304cc05d75aafccd25a3a4b746994a261c81884ac25a425ccaaff4c5308b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9ff3304cc05d75aafccd25a3a4b746994a261c81884ac25a425ccaaff4c5308b/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a63dd1b4e70a2a0c83c826372a6fed10a172985c42aeea3e83bbbfd80da03edf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a63dd1b4e70a2a0c83c826372a6fed10a172985c42aeea3e83bbbfd80da03edf/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a91834ecaaf17442c064d2197b65622b3ca40c2c4bf026f474e13a5a09f876d5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a91834ecaaf17442c064d2197b65622b3ca40c2c4bf026f474e13a5a09f876d5/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c059583a05f2a3587fe310359be8c83c05edc8b57a5b8ed03bdc022bbdf67b2e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c059583a05f2a3587fe310359be8c83c05edc8b57a5b8ed03bdc022bbdf67b2e/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c521abda0f4a31cd752ab1df32fe777bece4898a2d60d4d9590bb6948974440d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c521abda0f4a31cd752ab1df32fe777bece4898a2d60d4d9590bb6948974440d/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d979ddadcd6c33812034606292686cf42cef483e5144a9bdf23e63433b19f454/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d979ddadcd6c33812034606292686cf42cef483e5144a9bdf23e63433b19f454/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e8ad6808c5646869c98eb6e37029a9c4e1555e3df82d63c6b6f9e83e35266d60/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e8ad6808c5646869c98eb6e37029a9c4e1555e3df82d63c6b6f9e83e35266d60/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/eeb16e36e570980d9658b5271aaf40808802a15b4c4db30a80d656a266c06aa4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/eeb16e36e570980d9658b5271aaf40808802a15b4c4db30a80d656a266c06aa4/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1a5aacf3-197a-4725-b9ae-a0d0f11888e7/volumes/kubernetes.io~projected/kube-api-access-8vktq:{mountpoint:/var/lib/kubelet/pods/1a5aacf3-197a-4725-b9ae-a0d0f11888e7/volumes/kubernetes.io~projected/kube-api-access-8vktq major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1a5aacf3-197a-4725-b9ae-a0d0f11888e7/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/1a5aacf3-197a-4725-b9ae-a0d0f11888e7/volumes/kubernetes.io~secret/metrics-certs major:0 minor:347 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1f4fae7b-7758-422b-9271-451c4904c76e/volumes/kubernetes.io~projected/kube-api-access-6kjq8:{mountpoint:/var/lib/kubelet/pods/1f4fae7b-7758-422b-9271-451c4904c76e/volumes/kubernetes.io~projected/kube-api-access-6kjq8 major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/28265d99-26ec-4182-a806-4aac326a4781/volumes/kubernetes.io~projected/kube-api-access-hz52v:{mountpoint:/var/lib/kubelet/pods/28265d99-26ec-4182-a806-4aac326a4781/volumes/kubernetes.io~projected/kube-api-access-hz52v major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2feb206d-12b1-4761-96e2-321878073139/volumes/kubernetes.io~projected/kube-api-access-xhw4h:{mountpoint:/var/lib/kubelet/pods/2feb206d-12b1-4761-96e2-321878073139/volumes/kubernetes.io~projected/kube-api-access-xhw4h major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/318576c4-97c5-473c-9ea5-4a61c104f89f/volumes/kubernetes.io~projected/kube-api-access-h5mdx:{mountpoint:/var/lib/kubelet/pods/318576c4-97c5-473c-9ea5-4a61c104f89f/volumes/kubernetes.io~projected/kube-api-access-h5mdx major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3390fc0f-4489-4c05-b017-475fdb9c5670/volumes/kubernetes.io~projected/kube-api-access-sfwd8:{mountpoint:/var/lib/kubelet/pods/3390fc0f-4489-4c05-b017-475fdb9c5670/volumes/kubernetes.io~projected/kube-api-access-sfwd8 major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/368dc546-ddd5-4dfb-8b14-426e6084bd63/volumes/kubernetes.io~projected/kube-api-access-xn8t9:{mountpoint:/var/lib/kubelet/pods/368dc546-ddd5-4dfb-8b14-426e6084bd63/volumes/kubernetes.io~projected/kube-api-access-xn8t9 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/391964ff-6e62-49e9-89ca-a11cc36d5753/volumes/kubernetes.io~projected/kube-api-access-tjxm9:{mountpoint:/var/lib/kubelet/pods/391964ff-6e62-49e9-89ca-a11cc36d5753/volumes/kubernetes.io~projected/kube-api-access-tjxm9 major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4110027a-d96e-4b82-8206-3f4c30cc5978/volumes/kubernetes.io~projected/kube-api-access-tk6wz:{mountpoint:/var/lib/kubelet/pods/4110027a-d96e-4b82-8206-3f4c30cc5978/volumes/kubernetes.io~projected/kube-api-access-tk6wz major:0 minor:351 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/434e8ae7-f2c1-4195-a22e-366bf3290d79/volumes/kubernetes.io~projected/kube-api-access-44sns:{mountpoint:/var/lib/kubelet/pods/434e8ae7-f2c1-4195-a22e-366bf3290d79/volumes/kubernetes.io~projected/kube-api-access-44sns major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c/volumes/kubernetes.io~projected/kube-api-access-74zs2:{mountpoint:/var/lib/kubelet/pods/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c/volumes/kubernetes.io~projected/kube-api-access-74zs2 major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c/volumes/kubernetes.io~secret/metrics-tls major:0 minor:330 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b832e76-992a-4ff5-abe5-44ec22eba0d1/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/4b832e76-992a-4ff5-abe5-44ec22eba0d1/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b832e76-992a-4ff5-abe5-44ec22eba0d1/volumes/kubernetes.io~projected/kube-api-access-jg5j8:{mountpoint:/var/lib/kubelet/pods/4b832e76-992a-4ff5-abe5-44ec22eba0d1/volumes/kubernetes.io~projected/kube-api-access-jg5j8 major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b832e76-992a-4ff5-abe5-44ec22eba0d1/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/4b832e76-992a-4ff5-abe5-44ec22eba0d1/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/55811aff-113a-465d-9e99-0e4d78962934/volumes/kubernetes.io~projected/kube-api-access-x2txv:{mountpoint:/var/lib/kubelet/pods/55811aff-113a-465d-9e99-0e4d78962934/volumes/kubernetes.io~projected/kube-api-access-x2txv major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/58eb124c-7ccc-43bf-89d9-72b023b94a27/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/58eb124c-7ccc-43bf-89d9-72b023b94a27/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/58eb124c-7ccc-43bf-89d9-72b023b94a27/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/58eb124c-7ccc-43bf-89d9-72b023b94a27/volumes/kubernetes.io~empty-dir/tmp major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/58eb124c-7ccc-43bf-89d9-72b023b94a27/volumes/kubernetes.io~projected/kube-api-access-l685p:{mountpoint:/var/lib/kubelet/pods/58eb124c-7ccc-43bf-89d9-72b023b94a27/volumes/kubernetes.io~projected/kube-api-access-l685p major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5981da65-938a-4058-b3cb-459025feb5d6/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/5981da65-938a-4058-b3cb-459025feb5d6/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:352 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/598df9f3-580f-4014-9abd-a9d84272f7d7/volumes/kubernetes.io~projected/kube-api-access-qhng5:{mountpoint:/var/lib/kubelet/pods/598df9f3-580f-4014-9abd-a9d84272f7d7/volumes/kubernetes.io~projected/kube-api-access-qhng5 major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/598df9f3-580f-4014-9abd-a9d84272f7d7/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/598df9f3-580f-4014-9abd-a9d84272f7d7/volumes/kubernetes.io~secret/serving-cert major:0 minor:200 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/60427449-1081-4049-a2e8-3665f4dbdd63/volumes/kubernetes.io~projected/kube-api-access-ntgj6:{mountpoint:/var/lib/kubelet/pods/60427449-1081-4049-a2e8-3665f4dbdd63/volumes/kubernetes.io~projected/kube-api-access-ntgj6 major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/60427449-1081-4049-a2e8-3665f4dbdd63/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/60427449-1081-4049-a2e8-3665f4dbdd63/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6a89d9ac-d62b-42e4-934a-faaa4285277a/volumes/kubernetes.io~projected/kube-api-access-rddz8:{mountpoint:/var/lib/kubelet/pods/6a89d9ac-d62b-42e4-934a-faaa4285277a/volumes/kubernetes.io~projected/kube-api-access-rddz8 major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/84f02cd4-68fb-43b2-bb98-86f2fd944aad/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/84f02cd4-68fb-43b2-bb98-86f2fd944aad/volumes/kubernetes.io~secret/agent-certs major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8a9727e5-7f30-4be7-bc31-9a2af5b0d21e/volumes/kubernetes.io~projected/kube-api-access-txwb8:{mountpoint:/var/lib/kubelet/pods/8a9727e5-7f30-4be7-bc31-9a2af5b0d21e/volumes/kubernetes.io~projected/kube-api-access-txwb8 major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/90c31b99-6613-479f-9e60-f028a1967dad/volumes/kubernetes.io~projected/kube-api-access-8zkbx:{mountpoint:/var/lib/kubelet/pods/90c31b99-6613-479f-9e60-f028a1967dad/volumes/kubernetes.io~projected/kube-api-access-8zkbx major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/90c31b99-6613-479f-9e60-f028a1967dad/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/90c31b99-6613-479f-9e60-f028a1967dad/volumes/kubernetes.io~secret/serving-cert major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d85ad48-ac81-4f99-83d9-9e93db301d40/volumes/kubernetes.io~projected/kube-api-access-tmdfr:{mountpoint:/var/lib/kubelet/pods/9d85ad48-ac81-4f99-83d9-9e93db301d40/volumes/kubernetes.io~projected/kube-api-access-tmdfr major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9d85ad48-ac81-4f99-83d9-9e93db301d40/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/9d85ad48-ac81-4f99-83d9-9e93db301d40/volumes/kubernetes.io~secret/serving-cert major:0 minor:196 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13/volumes/kubernetes.io~projected/kube-api-access-lgnbc:{mountpoint:/var/lib/kubelet/pods/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13/volumes/kubernetes.io~projected/kube-api-access-lgnbc major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b7d2b389-602c-4ef9-a4eb-2caf80e330d0/volumes/kubernetes.io~projected/kube-api-access-ftbtr:{mountpoint:/var/lib/kubelet/pods/b7d2b389-602c-4ef9-a4eb-2caf80e330d0/volumes/kubernetes.io~projected/kube-api-access-ftbtr major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c06a3a88-4b60-4045-b794-e54e3d38068c/volumes/kubernetes.io~projected/kube-api-access-bh7z8:{mountpoint:/var/lib/kubelet/pods/c06a3a88-4b60-4045-b794-e54e3d38068c/volumes/kubernetes.io~projected/kube-api-access-bh7z8 major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c06a3a88-4b60-4045-b794-e54e3d38068c/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/c06a3a88-4b60-4045-b794-e54e3d38068c/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf5df1af-34a5-4168-9f99-b1e8319f6f2b/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/cf5df1af-34a5-4168-9f99-b1e8319f6f2b/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf5df1af-34a5-4168-9f99-b1e8319f6f2b/volumes/kubernetes.io~projected/kube-api-access-zb6hh:{mountpoint:/var/lib/kubelet/pods/cf5df1af-34a5-4168-9f99-b1e8319f6f2b/volumes/kubernetes.io~projected/kube-api-access-zb6hh major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf5df1af-34a5-4168-9f99-b1e8319f6f2b/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/cf5df1af-34a5-4168-9f99-b1e8319f6f2b/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf5df1af-34a5-4168-9f99-b1e8319f6f2b/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/cf5df1af-34a5-4168-9f99-b1e8319f6f2b/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e333b33a-d003-4886-83f5-6f1534ca8699/volumes/kubernetes.io~projected/kube-api-access-mzcwv:{mountpoint:/var/lib/kubelet/pods/e333b33a-d003-4886-83f5-6f1534ca8699/volumes/kubernetes.io~projected/kube-api-access-mzcwv major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f63cc71d-ab0b-4137-9cce-a1c780acfb09/volumes/kubernetes.io~projected/kube-api-access-z4nfk:{mountpoint:/var/lib/kubelet/pods/f63cc71d-ab0b-4137-9cce-a1c780acfb09/volumes/kubernetes.io~projected/kube-api-access-z4nfk major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fb977621-3d73-4a48-bc4c-a50f67da25d6/volumes/kubernetes.io~projected/kube-api-access-d8hdp:{mountpoint:/var/lib/kubelet/pods/fb977621-3d73-4a48-bc4c-a50f67da25d6/volumes/kubernetes.io~projected/kube-api-access-d8hdp major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fb977621-3d73-4a48-bc4c-a50f67da25d6/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/fb977621-3d73-4a48-bc4c-a50f67da25d6/volumes/kubernetes.io~secret/default-certificate major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fb977621-3d73-4a48-bc4c-a50f67da25d6/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/fb977621-3d73-4a48-bc4c-a50f67da25d6/volumes/kubernetes.io~secret/stats-auth major:0 minor:207 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/883318e3e241eacb99de761f70237616f92df8e451c8543a9c7f7f41a31bdc57/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/42da1aacd73c9b497b757ad35717b6e400ddb636d9d13fbe85297f7974ee50e9/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-107:{mountpoint:/var/lib/containers/storage/overlay/dd856dacfab468dde2d4d624d42b95ea51008eaa2b9d2ec8cfc80d90ae7be130/merged major:0 minor:107 fsType:overlay blockSize:0} overlay_0-108:{mountpoint:/var/lib/containers/storage/overlay/43ea8a678124824fbc56188e29ae13886e6ea70c2a4a666a9d30b3d50e189e1c/merged major:0 minor:108 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/afd1d908447dbb38377809c449a63f704c2d2bef44a64c57fbf77261487c9ea5/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/48098a415699c06ddfa5151170307a040aa052f2300db525be2e925ff9048d20/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/d1b8d2e638e16f4314e215007d9e93b3179f58f57cf6ed39658206e8f8b77dc3/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/38f7ec618888b3b9f333344ef87d0128fd2f5780ab1fb13803f67808268ed5d0/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/f874e2d57d396b156f0a012961403712df59db156024e958172e085b5dac8e2c/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/2821bb67b0ede405f87129b9180010ecd375f1473e58cfc6f6ff3ffede54ce35/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-136:{mountpoint:/var/lib/containers/storage/overlay/fd18943e1671f85ab985fedbaa20627983f4c8bd6d07670937c9ff379be2db16/merged major:0 minor:136 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/6cee2025057c5746a6e8f69c4b543bbaf82a57a2fb0abe9da152d54258d3c921/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/4a66107b2c680ab4ed36d8a9de3e3469713f7faf465f3b8bfbe6deda5dc85d59/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/c3547436ad563a58a5a77c870caa371d0471973e27bb38f28f179dbdb5d47617/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/1f3de095275bc7fbcfa7c0dba2cd4733ba4df56edd68b0c7404883bb0c3dfae9/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/f0d621a7b14b6fce4fc185955b681d744756169ba2c51baa1beec75a19053f11/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/551043f2bc18a2bdd675f407c03ae46df929797f753977a136ec8e6789b283b9/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/7a2d84888a8df8858684db4caea5e2d951d0bfd2c218b0b0545c345bbca8d956/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/e66e2474d814c86251af9b61df499e2a5c2f647eec4d4851547c4d82f3cfade9/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-191:{mountpoint:/var/lib/containers/storage/overlay/34a7165e78b5c9db49058a79c909ef0a1f93b3683aabf5e51f936e22974daab5/merged major:0 minor:191 fsType:overlay blockSize:0} overlay_0-206:{mountpoint:/var/lib/containers/storage/overlay/dfef7c2b90371f38afc479cfb422a0f3a908c9ff51ea6136645fd22a40f864a0/merged major:0 minor:206 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/1f5d333be659b9b90904b46d9bf3ae470f8dcc314b30d188b95d406223534db2/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/5822f5e1208c75ec6a13e23b5504efc17e01fa3d988ef56fb63a9a7f809baacd/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/85609ded80095a3c63dcb2f0939fd8bb3de9da886a4d3ef04f788184f3857c63/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/ed43d672f3dae6ecfdfa0c369ef6bc205b72e36d0b823ade20790f20aee06117/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/2ada46f3bc652d6e70ce2bbfd924677498c3e450379cd3d6403468f226cec4bf/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/b8ad7c023fc29216e8da65c21d2f1c36c46e172d307dbb165243304674d12159/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/328959d04859a6806c8c57a24b9f74a5e7e828a48f2b76a3225537b6c040cf97/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/3bd78717b0d9107334e25f541370bd5ec3c3325735e3a7be0c97ca044a910277/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/58b104524b217037236f2bb99732598f3acd7664611ac52a0ee4bf4cf2b0871c/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/08b1220f1fdadfd0869d2cc473868931c4d3c384335284c1c6f162d3694f172d/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-276:{mountpoint:/var/lib/containers/storage/overlay/f8e54de9be3de9e94cea7d52265a0132377573a2d87ed41c4e2ddbc4d13fbf76/merged major:0 minor:276 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/2b41fd72537e2a735c779b882d4ce96f8f18f4e30795992c21e5a6f4cbf353ca/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-280:{mountpoint:/var/lib/containers/storage/overlay/dc5f9eeba0cad15211dd2a20b55ca2e71e13570368fd2c0df4dbbc93e4474a7d/merged major:0 minor:280 fsType:overlay blockSize:0} overlay_0-282:{mountpoint:/var/lib/containers/storage/overlay/e95bf1a119ed92da20bcf573f528bcdb4cd8e2fc3920f6a3563230c72051460c/merged major:0 minor:282 fsType:overlay blockSize:0} overlay_0-288:{mountpoint:/var/lib/containers/storage/overlay/0318378f2ad36efca99def99acdec73297bbd50865104c1ab10778f8b29f512e/merged major:0 minor:288 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/33d0ab01680747aed41d03a5ad88c7330fd2db99b518b4224d17e193b2323051/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/61073be80e964774736efb10c575db96eafa641f9ef3d90b07702510cecadaad/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/dea8b5a3093b284b69ee6a9c34fd88aff893a54d2aae887cf5356b9ebea11b04/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-313:{mountpoint:/var/lib/containers/storage/overlay/2d3c0aa1a8cb7a2244c84603e34eecdd88ff160ad672bb408554be688e67531f/merged major:0 minor:313 fsType:overlay blockSize:0} overlay_0-326:{mountpoint:/var/lib/containers/storage/overlay/40355c6dab57f943838425236efb7bd3d40b6e2b7e027c905241c4ff793db198/merged major:0 minor:326 fsType:overlay blockSize:0} overlay_0-328:{mountpoint:/var/lib/containers/storage/overlay/852359aeecfd411b1fc8220badb59c3dcd58d6f2d1134f2f436337decb86fb65/merged major:0 minor:328 fsType:overlay blockSize:0} overlay_0-337:{mountpoint:/var/lib/containers/storage/overlay/4392bb3c0e3edd09c968b956d2b8fd38007765a4d97103374b39e940ed78722d/merged major:0 minor:337 fsType:overlay blockSize:0} overlay_0-339:{mountpoint:/var/lib/containers/storage/overlay/8f9df2fbf0904403e711a699ccb13ff7a5ede9389000fd8da9953baf1b184f3b/merged major:0 minor:339 fsType:overlay blockSize:0} overlay_0-341:{mountpoint:/var/lib/containers/storage/overlay/ab057a730e71f2dabfcbb6a894c757e193fa7ec0a2660174b5f02d69c7136e22/merged major:0 minor:341 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/48f89c9f9e757a02e5440c6dada73e215a3974085b239e952e2a390d578c39a8/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-361:{mountpoint:/var/lib/containers/storage/overlay/31b238a1a13eccfa9a6f6ac216958f7600315d0a45d4f68ffe56c852bb98f852/merged major:0 minor:361 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/a377ce8312b3aa0bea62ba3106dc7f59787c20da138c7807c898d3fab3621aab/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/18fef558a48dfc48550595fd4130c0b17f48eada683bad3aa9caafac30e46b3f/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-371:{mountpoint:/var/lib/containers/storage/overlay/d58c541984df8941a370f589efd90d4b0bfc6ad5ebf52948e1931db02b43cfa6/merged major:0 minor:371 fsType:overlay blockSize:0} overlay_0-373:{mountpoint:/var/lib/containers/storage/overlay/6cd63ab345fd4039535f65db509ddadf33113a976de23dfd1bd18cda134b4629/merged major:0 minor:373 fsType:overlay blockSize:0} overlay_0-45:{mountpoint:/var/lib/containers/storage/overlay/14dbb0b2b5d48de924fda298a8c3191da7893cfa7c44873477ece02189653cfb/merged major:0 minor:45 fsType:overlay blockSize:0} overlay_0-64:{mountpoint:/var/lib/containers/storage/overlay/09681d4be464d75538b3256331b5d52b4d930a6726de2e46f019324179edf52a/merged major:0 minor:64 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/5e22edb70dbe6ae71ce1cf312179fda43e376ebbd9e63caa77b3aabc855b7ad5/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/5e18d2401299c5fcc5de324452ba683971855970818c46db14837f0bc8a07f43/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/8442494aae04c91a517a1255dc464f28f5327692f2d62a9312ade7717a9c8076/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/d2292e538db9661cea22194af0d041cba36a498026799bebdd62c19812691e4e/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/da184fc964a58102aff747952c266de1c17dd1b34dd4f78288f262be9900414d/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/e0ac7f8829500ec721f912c6a687936e7ac97439b92fa4877df2fd461d3fd6d6/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/422e3156abe7129040a7260cfa3a12f1f6ea545a8f42bacf8fbd49725c5b3394/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/08b99e3e5c19ad02922f67a4536ad9060d01a7e47446937a1cc63d3412317e5e/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/68223f32895f1f588ef05fc221f8430b3d59469071ea5e15bf2a7b57a47e70ae/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.327829    5258 manager.go:217] Machine: {Timestamp:2026-10-30 21:54:45.327262752 +0000 UTC m=+0.058119908 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3064963 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dced3fdfbc2f8809bd5d3b7022881 SystemUUID:ec2dced3-fdfb-c2f8-809b-d5d3b7022881 BootID:f729a21e-3c06-4108-b6ee-9d5ea834bc41 Filesystems:[{Device:/var/lib/kubelet/pods/4b832e76-992a-4ff5-abe5-44ec22eba0d1/volumes/kubernetes.io~projected/kube-api-access-jg5j8 DeviceMajor:0 DeviceMinor:54 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/31e597c29ce3c5cd37781eb757bcbb836f60c0c35f8175a9de055213830f94c5/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/685a63a047a0a56db4b88892d89d1078fc3f10f05eeca1d9612b0f3ea9e4c325/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-45 DeviceMajor:0 DeviceMinor:45 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8a9727e5-7f30-4be7-bc31-9a2af5b0d21e/volumes/kubernetes.io~projected/kube-api-access-txwb8 DeviceMajor:0 DeviceMinor:223 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5096ecdc5fc157feab59a8eeb6452be018b66c80e9aaa1b4d9b2a9019b81aa49/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cf5df1af-34a5-4168-9f99-b1e8319f6f2b/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/60427449-1081-4049-a2e8-3665f4dbdd63/volumes/kubernetes.io~projected/kube-api-access-ntgj6 DeviceMajor:0 DeviceMinor:225 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e333b33a-d003-4886-83f5-6f1534ca8699/volumes/kubernetes.io~projected/kube-api-access-mzcwv DeviceMajor:0 DeviceMinor:319 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-64 DeviceMajor:0 DeviceMinor:64 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c/volumes/kubernetes.io~projected/kube-api-access-74zs2 DeviceMajor:0 DeviceMinor:222 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3fcb5c993a40dacc25eab0708eb13749ddd105f655f6d4be3add380338492011/userdata/shm DeviceMajor:0 DeviceMinor:353 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-361 DeviceMajor:0 DeviceMinor:361 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/31a2913cd0368886be5d3e71f810e02ad3e68ad8fe848291bf445fa71520caf5/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fb977621-3d73-4a48-bc4c-a50f67da25d6/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:205 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/eeb16e36e570980d9658b5271aaf40808802a15b4c4db30a80d656a266c06aa4/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/598df9f3-580f-4014-9abd-a9d84272f7d7/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:200 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-371 DeviceMajor:0 DeviceMinor:371 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/368dc546-ddd5-4dfb-8b14-426e6084bd63/volumes/kubernetes.io~projected/kube-api-access-xn8t9 DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cf5df1af-34a5-4168-9f99-b1e8319f6f2b/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7b904dda6f90486dc5b247fdd4ccd97b44f0a0186a6183f0f8b8012d83adb62e/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3be84ff88d557ae10b7cb8b434155d557616bf6c549ff6884a46ad0ae1502678/userdata/shm DeviceMajor:0 DeviceMinor:335 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/90c31b99-6613-479f-9e60-f028a1967dad/volumes/kubernetes.io~projected/kube-api-access-8zkbx DeviceMajor:0 DeviceMinor:214 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-136 DeviceMajor:0 DeviceMinor:136 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cf5df1af-34a5-4168-9f99-b1e8319f6f2b/volumes/kubernetes.io~projected/kube-api-access-zb6hh DeviceMajor:0 DeviceMinor:217 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6a89d9ac-d62b-42e4-934a-faaa4285277a/volumes/kubernetes.io~projected/kube-api-access-rddz8 DeviceMajor:0 DeviceMinor:224 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/936d57274e8af87aeb6f7ab5da7fc1aaea17ec0aa42dc7f2a20fcc36d592983e/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3f3f05e46b1874d6a32d6e1a7043cd9240cf260cf8f6501b7e634201e10abcb5/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:330 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9d85ad48-ac81-4f99-83d9-9e93db301d40/volumes/kubernetes.io~projected/kube-api-access-tmdfr DeviceMajor:0 DeviceMinor:221 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-313 DeviceMajor:0 DeviceMinor:313 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a91834ecaaf17442c064d2197b65622b3ca40c2c4bf026f474e13a5a09f876d5/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/59292563aa0e42c58ccb74e2987c4b9f7c43aba4e5a5e429b34677e620741a40/userdata/shm DeviceMajor:0 DeviceMinor:324 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/58eb124c-7ccc-43bf-89d9-72b023b94a27/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:48 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/511b57184e1dc4b98fdb1a27ded2834c8db4fb0b76899da2455479a7a8c7844b/userdata/shm DeviceMajor:0 DeviceMinor:243 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/55811aff-113a-465d-9e99-0e4d78962934/volumes/kubernetes.io~projected/kube-api-access-x2txv DeviceMajor:0 DeviceMinor:219 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c059583a05f2a3587fe310359be8c83c05edc8b57a5b8ed03bdc022bbdf67b2e/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-337 DeviceMajor:0 DeviceMinor:337 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4110027a-d96e-4b82-8206-3f4c30cc5978/volumes/kubernetes.io~projected/kube-api-access-tk6wz DeviceMajor:0 DeviceMinor:351 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/259a3710afcfbd1e3b4c0ad29ad45bb58457c4decd63ec1597325e04df40d5df/userdata/shm DeviceMajor:0 DeviceMinor:357 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/58eb124c-7ccc-43bf-89d9-72b023b94a27/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:49 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fb977621-3d73-4a48-bc4c-a50f67da25d6/volumes/kubernetes.io~projected/kube-api-access-d8hdp DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-282 DeviceMajor:0 DeviceMinor:282 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-107 DeviceMajor:0 DeviceMinor:107 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b7d2b389-602c-4ef9-a4eb-2caf80e330d0/volumes/kubernetes.io~projected/kube-api-access-ftbtr DeviceMajor:0 DeviceMinor:215 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-280 DeviceMajor:0 DeviceMinor:280 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5981da65-938a-4058-b3cb-459025feb5d6/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:352 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3c842eda0020037a73db90bf1983dbdbfb7bd86c94bf1703b54a1aa69bdc9df6/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d979ddadcd6c33812034606292686cf42cef483e5144a9bdf23e63433b19f454/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1a5aacf3-197a-4725-b9ae-a0d0f11888e7/volumes/kubernetes.io~projected/kube-api-access-8vktq DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-326 DeviceMajor:0 DeviceMinor:326 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4b832e76-992a-4ff5-abe5-44ec22eba0d1/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:50 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/60427449-1081-4049-a2e8-3665f4dbdd63/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9ff3304cc05d75aafccd25a3a4b746994a261c81884ac25a425ccaaff4c5308b/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/883fe27eaca3383b6a88a576d027d343f5697e16249acc5f1d4e49f47a6f9d32/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/318576c4-97c5-473c-9ea5-4a61c104f89f/volumes/kubernetes.io~projected/kube-api-access-h5mdx DeviceMajor:0 DeviceMinor:218 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-276 DeviceMajor:0 DeviceMinor:276 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-288 DeviceMajor:0 DeviceMinor:288 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13/volumes/kubernetes.io~projected/kube-api-access-lgnbc DeviceMajor:0 DeviceMinor:312 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/434e8ae7-f2c1-4195-a22e-366bf3290d79/volumes/kubernetes.io~projected/kube-api-access-44sns DeviceMajor:0 DeviceMinor:53 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/84f02cd4-68fb-43b2-bb98-86f2fd944aad/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:47 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3c2fe745fe055b7d4992fa9be354e37bd65d79a27fe39dadbd4b30e68d6bd167/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c06a3a88-4b60-4045-b794-e54e3d38068c/volumes/kubernetes.io~projected/kube-api-access-bh7z8 DeviceMajor:0 DeviceMinor:213 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e8ad6808c5646869c98eb6e37029a9c4e1555e3df82d63c6b6f9e83e35266d60/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/58eb124c-7ccc-43bf-89d9-72b023b94a27/volumes/kubernetes.io~projected/kube-api-access-l685p DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/391964ff-6e62-49e9-89ca-a11cc36d5753/volumes/kubernetes.io~projected/kube-api-access-tjxm9 DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-328 DeviceMajor:0 DeviceMinor:328 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1d3c640addc230d325287ec9275c058fad82f7b59b87cb31e51a51e8fb780bf6/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/598df9f3-580f-4014-9abd-a9d84272f7d7/volumes/kubernetes.io~projected/kube-api-access-qhng5 DeviceMajor:0 DeviceMinor:220 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1f4fae7b-7758-422b-9271-451c4904c76e/volumes/kubernetes.io~projected/kube-api-access-6kjq8 DeviceMajor:0 DeviceMinor:226 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/90c31b99-6613-479f-9e60-f028a1967dad/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fb977621-3d73-4a48-bc4c-a50f67da25d6/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-191 DeviceMajor:0 DeviceMinor:191 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9d85ad48-ac81-4f99-83d9-9e93db301d40/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:196 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/28265d99-26ec-4182-a806-4aac326a4781/volumes/kubernetes.io~projected/kube-api-access-hz52v DeviceMajor:0 DeviceMinor:52 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c521abda0f4a31cd752ab1df32fe777bece4898a2d60d4d9590bb6948974440d/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2feb206d-12b1-4761-96e2-321878073139/volumes/kubernetes.io~projected/kube-api-access-xhw4h DeviceMajor:0 DeviceMinor:51 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cf5df1af-34a5-4168-9f99-b1e8319f6f2b/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:216 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-341 DeviceMajor:0 DeviceMinor:341 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-373 DeviceMajor:0 DeviceMinor:373 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3390fc0f-4489-4c05-b017-475fdb9c5670/volumes/kubernetes.io~projected/kube-api-access-sfwd8 DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c06a3a88-4b60-4045-b794-e54e3d38068c/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-339 DeviceMajor:0 DeviceMinor:339 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1a5aacf3-197a-4725-b9ae-a0d0f11888e7/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:347 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/f63cc71d-ab0b-4137-9cce-a1c780acfb09/volumes/kubernetes.io~projected/kube-api-access-z4nfk DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-108 DeviceMajor:0 DeviceMinor:108 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4b832e76-992a-4ff5-abe5-44ec22eba0d1/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2633f368240fc088f6c7cc93569abe8a4a726c296461b014671b97787b7c87f0/userdata/shm DeviceMajor:0 DeviceMinor:355 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a63dd1b4e70a2a0c83c826372a6fed10a172985c42aeea3e83bbbfd80da03edf/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-206 DeviceMajor:0 DeviceMinor:206 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:259a3710afcfbd1 MacAddress:42:3f:15:c8:17:09 Speed:10000 Mtu:8901} {Name:2633f368240fc08 MacAddress:56:ab:fe:70:4a:30 Speed:10000 Mtu:8901} {Name:3be84ff88d557ae MacAddress:d2:1e:0e:9b:93:8a Speed:10000 Mtu:8901} {Name:3f3f05e46b1874d MacAddress:de:62:ce:85:34:ff Speed:10000 Mtu:8901} {Name:3fcb5c993a40dac MacAddress:9a:a8:95:15:36:0c Speed:10000 Mtu:8901} {Name:5096ecdc5fc157f MacAddress:8e:34:bd:cc:b3:ae Speed:10000 Mtu:8901} {Name:511b57184e1dc4b MacAddress:32:3a:7c:b3:67:71 Speed:10000 Mtu:8901} {Name:59292563aa0e42c MacAddress:fa:5d:4b:0b:97:d7 Speed:10000 Mtu:8901} {Name:685a63a047a0a56 MacAddress:46:77:88:03:c4:0d Speed:10000 Mtu:8901} {Name:7b904dda6f90486 MacAddress:e2:2a:ed:59:a0:7d Speed:10000 Mtu:8901} {Name:9ff3304cc05d75a MacAddress:7e:b0:37:f9:4d:b4 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:75:67:2f:43:63 Speed:0 Mtu:9001} {Name:br-int MacAddress:16:0e:5b:2a:d8:d0 Speed:0 Mtu:8901} {Name:c059583a05f2a35 MacAddress:da:06:9e:04:4c:16 Speed:10000 Mtu:8901} {Name:d979ddadcd6c338 MacAddress:f6:27:5d:7c:ec:b4 Speed:10000 Mtu:8901} {Name:e8ad6808c564686 MacAddress:c2:ac:9b:75:af:5d Speed:10000 Mtu:8901} {Name:eeb16e36e570980 MacAddress:16:3e:3f:d6:f0:63 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:75:67:2f:43:63 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:6e:d8:37:16:9c:56 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:72:cb:df:a0:a1:ca Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.328317    5258 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.328362    5258 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.328914    5258 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.328963    5258 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-32.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.329281    5258 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.329294    5258 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.329308    5258 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.329336    5258 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.329446    5258 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.329957    5258 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.330079    5258 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.330114    5258 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.330128    5258 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.330138    5258 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.330147    5258 kubelet.go:405] "Adding apiserver pod source"
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.330155    5258 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.330807    5258 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.330818    5258 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:54:45.332579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.331222    5258 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 21:54:45.333475 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333460    5258 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 21:54:45.333475 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333474    5258 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:54:45.333576 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333566    5258 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 21:54:45.333771 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333760    5258 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 21:54:45.333807 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333789    5258 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 21:54:45.333888 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333877    5258 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 21:54:45.333917 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333897    5258 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 21:54:45.333917 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333904    5258 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 21:54:45.333988 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333918    5258 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 21:54:45.333988 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333924    5258 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 21:54:45.333988 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333930    5258 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 21:54:45.333988 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333936    5258 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 21:54:45.333988 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333945    5258 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 21:54:45.333988 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333955    5258 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 21:54:45.333988 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333969    5258 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 21:54:45.333988 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333979    5258 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 21:54:45.333988 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.333990    5258 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 21:54:45.334236 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.334022    5258 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 21:54:45.334236 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.334031    5258 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 21:54:45.337353 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.337339    5258 server.go:1263] "Started kubelet"
Oct 30 21:54:45.337836 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.337413    5258 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 21:54:45.337836 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.337489    5258 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 21:54:45.337836 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.337575    5258 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 21:54:45.338081 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.338039    5258 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 21:54:45.337874 ip-10-0-137-32 systemd[1]: Started Kubernetes Kubelet.
Oct 30 21:54:45.339180 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.339154    5258 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 21:54:45.342377 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.342356    5258 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 21:54:45.342377 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.342371    5258 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 21:54:45.342631 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.342443    5258 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 21:54:45.344644 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.344618    5258 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 21:54:45.344742 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.344660    5258 factory.go:153] Registering CRI-O factory
Oct 30 21:54:45.344742 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.344679    5258 factory.go:223] Registration of the crio container factory successfully
Oct 30 21:54:45.344742 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.342536    5258 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:48:34 +0000 UTC" deadline="2028-06-13 13:41:59.557953776 +0000 UTC"
Oct 30 21:54:45.344742 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.344721    5258 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14199h47m14.213238058s"
Oct 30 21:54:45.344742 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.344732    5258 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 21:54:45.344742 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.344743    5258 factory.go:55] Registering systemd factory
Oct 30 21:54:45.345003 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.344751    5258 factory.go:223] Registration of the systemd container factory successfully
Oct 30 21:54:45.345003 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.344768    5258 factory.go:103] Registering Raw factory
Oct 30 21:54:45.345003 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.344819    5258 manager.go:1199] Started watching for new ooms in manager
Oct 30 21:54:45.345003 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.343523    5258 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 21:54:45.345003 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:54:45.342743    5258 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-32.us-west-1.compute.internal\" not found"
Oct 30 21:54:45.346215 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.346065    5258 manager.go:319] Starting recovery of all containers
Oct 30 21:54:45.348731 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348703    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d85ad48-ac81-4f99-83d9-9e93db301d40" volumeName="kubernetes.io/projected/9d85ad48-ac81-4f99-83d9-9e93db301d40-kube-api-access-tmdfr" seLinuxMountContext=""
Oct 30 21:54:45.348797 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348731    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b832e76-992a-4ff5-abe5-44ec22eba0d1" volumeName="kubernetes.io/projected/4b832e76-992a-4ff5-abe5-44ec22eba0d1-kube-api-access-jg5j8" seLinuxMountContext=""
Oct 30 21:54:45.348797 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348741    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3390fc0f-4489-4c05-b017-475fdb9c5670" volumeName="kubernetes.io/projected/3390fc0f-4489-4c05-b017-475fdb9c5670-kube-api-access-sfwd8" seLinuxMountContext=""
Oct 30 21:54:45.348797 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348750    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a4f3ab5-fba1-457f-bd3f-2d760bf6372c" volumeName="kubernetes.io/configmap/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-config-volume" seLinuxMountContext=""
Oct 30 21:54:45.348797 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348758    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="598df9f3-580f-4014-9abd-a9d84272f7d7" volumeName="kubernetes.io/projected/598df9f3-580f-4014-9abd-a9d84272f7d7-kube-api-access-qhng5" seLinuxMountContext=""
Oct 30 21:54:45.348797 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348765    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60427449-1081-4049-a2e8-3665f4dbdd63" volumeName="kubernetes.io/configmap/60427449-1081-4049-a2e8-3665f4dbdd63-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 21:54:45.348797 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348772    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60427449-1081-4049-a2e8-3665f4dbdd63" volumeName="kubernetes.io/projected/60427449-1081-4049-a2e8-3665f4dbdd63-kube-api-access-ntgj6" seLinuxMountContext=""
Oct 30 21:54:45.348797 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348779    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb977621-3d73-4a48-bc4c-a50f67da25d6" volumeName="kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-stats-auth" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348807    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2feb206d-12b1-4761-96e2-321878073139" volumeName="kubernetes.io/configmap/2feb206d-12b1-4761-96e2-321878073139-iptables-alerter-script" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348816    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3390fc0f-4489-4c05-b017-475fdb9c5670" volumeName="kubernetes.io/configmap/3390fc0f-4489-4c05-b017-475fdb9c5670-cni-binary-copy" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348823    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="416a5a6a-c3b4-460e-9382-4ed77d5ca406" volumeName="kubernetes.io/configmap/416a5a6a-c3b4-460e-9382-4ed77d5ca406-nginx-conf" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348830    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a89d9ac-d62b-42e4-934a-faaa4285277a" volumeName="kubernetes.io/configmap/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-config" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348836    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90c31b99-6613-479f-9e60-f028a1967dad" volumeName="kubernetes.io/configmap/90c31b99-6613-479f-9e60-f028a1967dad-config" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348843    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf5df1af-34a5-4168-9f99-b1e8319f6f2b" volumeName="kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-certificates" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348851    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="391964ff-6e62-49e9-89ca-a11cc36d5753" volumeName="kubernetes.io/projected/391964ff-6e62-49e9-89ca-a11cc36d5753-kube-api-access-tjxm9" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348859    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60427449-1081-4049-a2e8-3665f4dbdd63" volumeName="kubernetes.io/empty-dir/60427449-1081-4049-a2e8-3665f4dbdd63-snapshots" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348869    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60427449-1081-4049-a2e8-3665f4dbdd63" volumeName="kubernetes.io/empty-dir/60427449-1081-4049-a2e8-3665f4dbdd63-tmp" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348877    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b7d2b389-602c-4ef9-a4eb-2caf80e330d0" volumeName="kubernetes.io/projected/b7d2b389-602c-4ef9-a4eb-2caf80e330d0-kube-api-access-ftbtr" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348883    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb977621-3d73-4a48-bc4c-a50f67da25d6" volumeName="kubernetes.io/projected/fb977621-3d73-4a48-bc4c-a50f67da25d6-kube-api-access-d8hdp" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348891    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b832e76-992a-4ff5-abe5-44ec22eba0d1" volumeName="kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-env-overrides" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348898    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf5df1af-34a5-4168-9f99-b1e8319f6f2b" volumeName="kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-kube-api-access-zb6hh" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348906    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="434e8ae7-f2c1-4195-a22e-366bf3290d79" volumeName="kubernetes.io/projected/434e8ae7-f2c1-4195-a22e-366bf3290d79-kube-api-access-44sns" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348914    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b832e76-992a-4ff5-abe5-44ec22eba0d1" volumeName="kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348921    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b832e76-992a-4ff5-abe5-44ec22eba0d1" volumeName="kubernetes.io/secret/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348928    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="598df9f3-580f-4014-9abd-a9d84272f7d7" volumeName="kubernetes.io/configmap/598df9f3-580f-4014-9abd-a9d84272f7d7-config" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348935    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84f02cd4-68fb-43b2-bb98-86f2fd944aad" volumeName="kubernetes.io/configmap/84f02cd4-68fb-43b2-bb98-86f2fd944aad-konnectivity-ca" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348954    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f9c30fb-c07a-4566-8f99-7ddb1ee9da13" volumeName="kubernetes.io/projected/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-api-access-lgnbc" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348968    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf5df1af-34a5-4168-9f99-b1e8319f6f2b" volumeName="kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-trusted-ca" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348980    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf5df1af-34a5-4168-9f99-b1e8319f6f2b" volumeName="kubernetes.io/empty-dir/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-ca-trust-extracted" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348988    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f4fae7b-7758-422b-9271-451c4904c76e" volumeName="kubernetes.io/projected/1f4fae7b-7758-422b-9271-451c4904c76e-kube-api-access-6kjq8" seLinuxMountContext=""
Oct 30 21:54:45.348990 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.348996    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="58eb124c-7ccc-43bf-89d9-72b023b94a27" volumeName="kubernetes.io/projected/58eb124c-7ccc-43bf-89d9-72b023b94a27-kube-api-access-l685p" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349003    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60427449-1081-4049-a2e8-3665f4dbdd63" volumeName="kubernetes.io/secret/60427449-1081-4049-a2e8-3665f4dbdd63-serving-cert" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349011    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e333b33a-d003-4886-83f5-6f1534ca8699" volumeName="kubernetes.io/projected/e333b33a-d003-4886-83f5-6f1534ca8699-kube-api-access-mzcwv" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349019    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2feb206d-12b1-4761-96e2-321878073139" volumeName="kubernetes.io/projected/2feb206d-12b1-4761-96e2-321878073139-kube-api-access-xhw4h" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349026    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="434e8ae7-f2c1-4195-a22e-366bf3290d79" volumeName="kubernetes.io/empty-dir/434e8ae7-f2c1-4195-a22e-366bf3290d79-tmp-dir" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349033    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a4f3ab5-fba1-457f-bd3f-2d760bf6372c" volumeName="kubernetes.io/projected/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-kube-api-access-74zs2" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349040    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="598df9f3-580f-4014-9abd-a9d84272f7d7" volumeName="kubernetes.io/secret/598df9f3-580f-4014-9abd-a9d84272f7d7-serving-cert" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349046    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c06a3a88-4b60-4045-b794-e54e3d38068c" volumeName="kubernetes.io/projected/c06a3a88-4b60-4045-b794-e54e3d38068c-kube-api-access-bh7z8" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349053    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5981da65-938a-4058-b3cb-459025feb5d6" volumeName="kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349061    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a89d9ac-d62b-42e4-934a-faaa4285277a" volumeName="kubernetes.io/projected/6a89d9ac-d62b-42e4-934a-faaa4285277a-kube-api-access-rddz8" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349068    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="84f02cd4-68fb-43b2-bb98-86f2fd944aad" volumeName="kubernetes.io/secret/84f02cd4-68fb-43b2-bb98-86f2fd944aad-agent-certs" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349075    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d85ad48-ac81-4f99-83d9-9e93db301d40" volumeName="kubernetes.io/configmap/9d85ad48-ac81-4f99-83d9-9e93db301d40-config" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349082    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f63cc71d-ab0b-4137-9cce-a1c780acfb09" volumeName="kubernetes.io/projected/f63cc71d-ab0b-4137-9cce-a1c780acfb09-kube-api-access-z4nfk" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349090    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="28265d99-26ec-4182-a806-4aac326a4781" volumeName="kubernetes.io/projected/28265d99-26ec-4182-a806-4aac326a4781-kube-api-access-hz52v" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349097    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b832e76-992a-4ff5-abe5-44ec22eba0d1" volumeName="kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovnkube-config" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349105    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a9727e5-7f30-4be7-bc31-9a2af5b0d21e" volumeName="kubernetes.io/projected/8a9727e5-7f30-4be7-bc31-9a2af5b0d21e-kube-api-access-txwb8" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349112    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90c31b99-6613-479f-9e60-f028a1967dad" volumeName="kubernetes.io/secret/90c31b99-6613-479f-9e60-f028a1967dad-serving-cert" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349119    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf5df1af-34a5-4168-9f99-b1e8319f6f2b" volumeName="kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349126    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf5df1af-34a5-4168-9f99-b1e8319f6f2b" volumeName="kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-installation-pull-secrets" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349133    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f4fae7b-7758-422b-9271-451c4904c76e" volumeName="kubernetes.io/configmap/1f4fae7b-7758-422b-9271-451c4904c76e-telemetry-config" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349140    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3390fc0f-4489-4c05-b017-475fdb9c5670" volumeName="kubernetes.io/configmap/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-daemon-config" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349147    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d85ad48-ac81-4f99-83d9-9e93db301d40" volumeName="kubernetes.io/configmap/9d85ad48-ac81-4f99-83d9-9e93db301d40-trusted-ca" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349154    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f63cc71d-ab0b-4137-9cce-a1c780acfb09" volumeName="kubernetes.io/configmap/f63cc71d-ab0b-4137-9cce-a1c780acfb09-serviceca" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349161    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fb977621-3d73-4a48-bc4c-a50f67da25d6" volumeName="kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-default-certificate" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349168    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="368dc546-ddd5-4dfb-8b14-426e6084bd63" volumeName="kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349175    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="368dc546-ddd5-4dfb-8b14-426e6084bd63" volumeName="kubernetes.io/projected/368dc546-ddd5-4dfb-8b14-426e6084bd63-kube-api-access-xn8t9" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349189    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="58eb124c-7ccc-43bf-89d9-72b023b94a27" volumeName="kubernetes.io/empty-dir/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-tuned" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349197    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c06a3a88-4b60-4045-b794-e54e3d38068c" volumeName="kubernetes.io/secret/c06a3a88-4b60-4045-b794-e54e3d38068c-cert" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349205    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a5aacf3-197a-4725-b9ae-a0d0f11888e7" volumeName="kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349214    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a4f3ab5-fba1-457f-bd3f-2d760bf6372c" volumeName="kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349222    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="58eb124c-7ccc-43bf-89d9-72b023b94a27" volumeName="kubernetes.io/empty-dir/58eb124c-7ccc-43bf-89d9-72b023b94a27-tmp" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349230    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90c31b99-6613-479f-9e60-f028a1967dad" volumeName="kubernetes.io/projected/90c31b99-6613-479f-9e60-f028a1967dad-kube-api-access-8zkbx" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349237    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f9c30fb-c07a-4566-8f99-7ddb1ee9da13" volumeName="kubernetes.io/empty-dir/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-data-volume" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349245    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1a5aacf3-197a-4725-b9ae-a0d0f11888e7" volumeName="kubernetes.io/projected/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-kube-api-access-8vktq" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349255    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="368dc546-ddd5-4dfb-8b14-426e6084bd63" volumeName="kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-cni-binary-copy" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349281    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="55811aff-113a-465d-9e99-0e4d78962934" volumeName="kubernetes.io/projected/55811aff-113a-465d-9e99-0e4d78962934-kube-api-access-x2txv" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349290    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf5df1af-34a5-4168-9f99-b1e8319f6f2b" volumeName="kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-bound-sa-token" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349298    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4110027a-d96e-4b82-8206-3f4c30cc5978" volumeName="kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349306    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a4f3ab5-fba1-457f-bd3f-2d760bf6372c" volumeName="kubernetes.io/empty-dir/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-tmp-dir" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349314    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9d85ad48-ac81-4f99-83d9-9e93db301d40" volumeName="kubernetes.io/secret/9d85ad48-ac81-4f99-83d9-9e93db301d40-serving-cert" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349324    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f9c30fb-c07a-4566-8f99-7ddb1ee9da13" volumeName="kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349335    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="318576c4-97c5-473c-9ea5-4a61c104f89f" volumeName="kubernetes.io/projected/318576c4-97c5-473c-9ea5-4a61c104f89f-kube-api-access-h5mdx" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349347    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="368dc546-ddd5-4dfb-8b14-426e6084bd63" volumeName="kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349359    5258 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="60427449-1081-4049-a2e8-3665f4dbdd63" volumeName="kubernetes.io/configmap/60427449-1081-4049-a2e8-3665f4dbdd63-service-ca-bundle" seLinuxMountContext=""
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349369    5258 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 21:54:45.349883 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.349376    5258 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 21:54:45.353378 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.353357    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 21:54:45.353525 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.353503    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 21:54:45.371559 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.371533    5258 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 21:54:45.372703 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.372679    5258 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 21:54:45.372703 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.372706    5258 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 21:54:45.372860 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.372726    5258 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 21:54:45.372860 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:54:45.372760    5258 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 21:54:45.402290 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.402253    5258 generic.go:356] "Generic (PLEG): container finished" podID="45ec9fc5e2b74da3533af9e11f797bd9" containerID="2aed4abfb9fb57ca1fdb71e33ac3b3d636733bf961476b559f643e5d60d9de84" exitCode=0
Oct 30 21:54:45.418472 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.418434    5258 generic.go:356] "Generic (PLEG): container finished" podID="368dc546-ddd5-4dfb-8b14-426e6084bd63" containerID="526269cc09559e63923eabb2fbed40549717d979aec84a4a706adc5c0390464e" exitCode=0
Oct 30 21:54:45.418472 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.418467    5258 generic.go:356] "Generic (PLEG): container finished" podID="368dc546-ddd5-4dfb-8b14-426e6084bd63" containerID="b79b89c7a3ef73b58add650de242aaeddc0580a9f34b9bc9b6418022cd03126a" exitCode=0
Oct 30 21:54:45.418697 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.418478    5258 generic.go:356] "Generic (PLEG): container finished" podID="368dc546-ddd5-4dfb-8b14-426e6084bd63" containerID="98e68aa075af7cd29c78649445f6dd1a058a98777739c2a0d736de2cb60ac2fa" exitCode=0
Oct 30 21:54:45.418697 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.418487    5258 generic.go:356] "Generic (PLEG): container finished" podID="368dc546-ddd5-4dfb-8b14-426e6084bd63" containerID="ff0c40bc93fc4d672420268e6d7e028a2fd6c22de732b0e1540dae60d77fae4f" exitCode=0
Oct 30 21:54:45.418697 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.418495    5258 generic.go:356] "Generic (PLEG): container finished" podID="368dc546-ddd5-4dfb-8b14-426e6084bd63" containerID="f547d54dfa3ec3ca5fd7940976b2a4b82067c469d70f4089be4e80df12f39651" exitCode=0
Oct 30 21:54:45.418697 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.418503    5258 generic.go:356] "Generic (PLEG): container finished" podID="368dc546-ddd5-4dfb-8b14-426e6084bd63" containerID="1440af7cf1deceb7fe8fe45a80e12e936cbf2cd2872a30bb7d4bb45a3a76a7ae" exitCode=0
Oct 30 21:54:45.421995 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.421975    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 21:54:45.422104 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.421999    5258 generic.go:356] "Generic (PLEG): container finished" podID="9d85ad48-ac81-4f99-83d9-9e93db301d40" containerID="23fcb3fb2dc40787e1e84b1059abcc8262c503e3dc64169257f2b25d4c114dda" exitCode=255
Oct 30 21:54:45.437331 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.437313    5258 manager.go:324] Recovery completed
Oct 30 21:54:45.444917 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:54:45.444888    5258 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-32.us-west-1.compute.internal\" not found"
Oct 30 21:54:45.456773 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.456756    5258 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:54:45.458515 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.458501    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:54:45.458623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.458531    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:54:45.458623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.458541    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:54:45.460663 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.460645    5258 cpu_manager.go:226] "Starting" policy="none"
Oct 30 21:54:45.460663 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.460658    5258 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:54:45.460769 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.460660    5258 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 21:54:45.460769 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.460724    5258 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 21:54:45.460845 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.460833    5258 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 21:54:45.460888 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.460846    5258 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 21:54:45.460924 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.460888    5258 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 21:54:45.460924 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.460894    5258 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 21:54:45.460924 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.460900    5258 policy_none.go:50] "Start"
Oct 30 21:54:45.460924 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.460910    5258 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 21:54:45.460924 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.460920    5258 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 21:54:45.461064 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.461055    5258 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 21:54:45.461093 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.461064    5258 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 21:54:45.461093 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.461070    5258 policy_none.go:44] "Start"
Oct 30 21:54:45.461570 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.461557    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:54:45.461629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.461584    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:54:45.461629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.461616    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:54:45.465519 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.465495    5258 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 21:54:45.468033 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.468021    5258 manager.go:341] "Starting Device Plugin manager"
Oct 30 21:54:45.468105 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:54:45.468043    5258 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 21:54:45.468105 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.468052    5258 server.go:87] "Starting device plugin registration server"
Oct 30 21:54:45.468294 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.468284    5258 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 21:54:45.468326 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.468295    5258 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 21:54:45.468407 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.468392    5258 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 21:54:45.468514 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.468481    5258 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 21:54:45.468584 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.468521    5258 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 21:54:45.468584 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.468529    5258 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 21:54:45.468706 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.468578    5258 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:54:45.468511562Z","UUID":"666198e8-3e73-4ee9-b68a-da0cb6735364","Handler":null,"Name":"","Endpoint":""}
Oct 30 21:54:45.470086 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:54:45.470044    5258 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 21:54:45.470191 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:54:45.470088    5258 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-32.us-west-1.compute.internal\" not found"
Oct 30 21:54:45.470544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.470374    5258 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 21:54:45.470544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.470411    5258 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 21:54:45.472857 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.472819    5258 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"]
Oct 30 21:54:45.472993 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.472978    5258 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:54:45.474066 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.474044    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:54:45.474185 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.474073    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:54:45.474185 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.474083    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:54:45.474394 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.474382    5258 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:54:45.474532 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.474516    5258 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:54:45.475320 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.475298    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:54:45.475391 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.475324    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:54:45.475391 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.475335    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:54:45.475391 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.475358    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:54:45.475391 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.475383    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:54:45.475521 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.475397    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:54:45.475579 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:54:45.475548    5258 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-32.us-west-1.compute.internal\" not found" node="ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.475680 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.475652    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal" event={"ID":"13606120155d66241850ec4f52f0e0f4","Type":"ContainerStarted","Data":"133d82feb8c5c77efce6a662ec3a16f42b043d45b5153f3de8c336b171b17e78"}
Oct 30 21:54:45.475726 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.475686    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal" event={"ID":"13606120155d66241850ec4f52f0e0f4","Type":"ContainerStarted","Data":"3c2fe745fe055b7d4992fa9be354e37bd65d79a27fe39dadbd4b30e68d6bd167"}
Oct 30 21:54:45.475726 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.475704    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal" event={"ID":"45ec9fc5e2b74da3533af9e11f797bd9","Type":"ContainerStarted","Data":"426087bf5f3991bb8ca922f8aa536818f97e33507bbcf8bd0ac72679929247f6"}
Oct 30 21:54:45.475726 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.475720    5258 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:54:45.475866 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.475718    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal" event={"ID":"45ec9fc5e2b74da3533af9e11f797bd9","Type":"ContainerDied","Data":"2aed4abfb9fb57ca1fdb71e33ac3b3d636733bf961476b559f643e5d60d9de84"}
Oct 30 21:54:45.475866 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.475801    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal" event={"ID":"45ec9fc5e2b74da3533af9e11f797bd9","Type":"ContainerStarted","Data":"1d3c640addc230d325287ec9275c058fad82f7b59b87cb31e51a51e8fb780bf6"}
Oct 30 21:54:45.476650 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.476631    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:54:45.476716 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.476666    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:54:45.476716 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.476681    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:54:45.476814 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:54:45.476799    5258 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-32.us-west-1.compute.internal\" not found" node="ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.540823 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.540800    5258 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 21:54:45.542562 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.542548    5258 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:54:45.544627 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.544613    5258 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.568849 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.568830    5258 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:54:45.569972 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.569951    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:54:45.570049 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.569988    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:54:45.570049 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.570002    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:54:45.570157 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.570054    5258 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.592089 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.592065    5258 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:54:45.592089 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.592066    5258 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:54:45.592360 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.592348    5258 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:54:45.638768 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.638742    5258 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:54:45.638850 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:54:45.638833    5258 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.638918 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.638856    5258 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.641902 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.641883    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45ec9fc5e2b74da3533af9e11f797bd9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"45ec9fc5e2b74da3533af9e11f797bd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.641988 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.641910    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45ec9fc5e2b74da3533af9e11f797bd9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"45ec9fc5e2b74da3533af9e11f797bd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.641988 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.641927    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13606120155d66241850ec4f52f0e0f4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"13606120155d66241850ec4f52f0e0f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.691140 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.691121    5258 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.691203 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.691175    5258 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.691628 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.691616    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeNotReady"
Oct 30 21:54:45.691674 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.691643    5258 setters.go:546] "Node became not ready" node="ip-10-0-137-32.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-10-30T21:54:45Z","lastTransitionTime":"2026-10-30T21:54:45Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"}
Oct 30 21:54:45.696511 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.696497    5258 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:54:45.696550 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:54:45.696530    5258 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.742438 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.742413    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45ec9fc5e2b74da3533af9e11f797bd9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"45ec9fc5e2b74da3533af9e11f797bd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.742504 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.742454    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45ec9fc5e2b74da3533af9e11f797bd9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"45ec9fc5e2b74da3533af9e11f797bd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.742504 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.742471    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13606120155d66241850ec4f52f0e0f4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"13606120155d66241850ec4f52f0e0f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.742561 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.742418    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45ec9fc5e2b74da3533af9e11f797bd9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"45ec9fc5e2b74da3533af9e11f797bd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.742561 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.742527    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13606120155d66241850ec4f52f0e0f4-config\") pod \"kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"13606120155d66241850ec4f52f0e0f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.742561 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.742548    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45ec9fc5e2b74da3533af9e11f797bd9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal\" (UID: \"45ec9fc5e2b74da3533af9e11f797bd9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:45.755142 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:45.755118    5258 nodeinfomanager.go:471] existing CSINode "ip-10-0-137-32.us-west-1.compute.internal" is owned by different node (oldNodeID="41049a52-6004-4e5b-9177-522bf4004624", newNodeID=""), cleaning up...
Oct 30 21:54:46.330714 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.330689    5258 apiserver.go:52] "Watching apiserver"
Oct 30 21:54:46.433630 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.433577    5258 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:46.433797 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.433716    5258 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:46.488610 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.488570    5258 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 21:54:46.489431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.489403    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9","kube-system/global-pull-secret-syncer-2hjmh","openshift-dns/dns-default-rbmtp","openshift-image-registry/image-registry-5b9c975d75-kkjl6","openshift-network-diagnostics/network-check-target-6gnzt","kube-system/kas-connection-checker-685895c7c9-bhpxt","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j","openshift-network-console/networking-console-plugin-86c478bb88-bj87t","openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7","openshift-multus/multus-additional-cni-plugins-z4222","openshift-multus/network-metrics-daemon-xpf4w","openshift-ovn-kubernetes/ovnkube-node-nbrqj","kube-system/kas-connection-checker-685895c7c9-d9h59","openshift-image-registry/node-ca-p97r6","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wlt6w","openshift-network-operator/iptables-alerter-9wkj7","kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal","openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7","openshift-kube-storage-version-migrator/migrator-66df5d496b-jdpbb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal","openshift-dns/node-resolver-bvgp5","openshift-ingress-canary/ingress-canary-tr6dv","openshift-cluster-node-tuning-operator/tuned-kw6b8","openshift-console-operator/console-operator-7cd56b8dbc-57lx9","kube-system/kas-connection-checker-685895c7c9-x9kk6","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9","openshift-multus/multus-cs98z","openshift-insights/insights-runtime-extractor-s6x2r","openshift-network-diagnostics/network-check-source-6f78d59f99-rdsd9","openshift-ingress/router-default-5c6c4f6cbf-rnprt","openshift-insights/insights-operator-7c4986d449-dglp8","kube-system/konnectivity-agent-hjj9v"]
Oct 30 21:54:46.490665 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.490647    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:46.494012 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.493987    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:46.494485 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.494467    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:46.496155 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.496136    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:46.499771 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.499752    5258 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:54:46.499886 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:54:46.499790    5258 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:46.499886 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.499824    5258 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:54:46.499886 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:54:46.499867    5258 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-32.us-west-1.compute.internal"
Oct 30 21:54:46.502566 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.502549    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.504360 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.504342    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:46.546520 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.546497    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90c31b99-6613-479f-9e60-f028a1967dad-config\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:46.546622 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.546532    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:46.546622 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.546558    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:46.546745 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.546627    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-bound-sa-token\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.546745 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.546704    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-sys-fs\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.546745 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.546730    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzcwv\" (UniqueName: \"kubernetes.io/projected/e333b33a-d003-4886-83f5-6f1534ca8699-kube-api-access-mzcwv\") pod \"migrator-66df5d496b-jdpbb\" (UID: \"e333b33a-d003-4886-83f5-6f1534ca8699\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-jdpbb"
Oct 30 21:54:46.546875 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.546763    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zkbx\" (UniqueName: \"kubernetes.io/projected/90c31b99-6613-479f-9e60-f028a1967dad-kube-api-access-8zkbx\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:46.546875 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.546839    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5mdx\" (UniqueName: \"kubernetes.io/projected/318576c4-97c5-473c-9ea5-4a61c104f89f-kube-api-access-h5mdx\") pod \"network-check-source-6f78d59f99-rdsd9\" (UID: \"318576c4-97c5-473c-9ea5-4a61c104f89f\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rdsd9"
Oct 30 21:54:46.546875 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.546868    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f63cc71d-ab0b-4137-9cce-a1c780acfb09-host\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:54:46.547016 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.546898    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-ca-trust-extracted\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.547068 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.547028    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-ca-trust-extracted\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.547276 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.547252    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-certificates\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.547347 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.547321    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb6hh\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-kube-api-access-zb6hh\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.547405 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.547385    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh7z8\" (UniqueName: \"kubernetes.io/projected/c06a3a88-4b60-4045-b794-e54e3d38068c-kube-api-access-bh7z8\") pod \"ingress-canary-tr6dv\" (UID: \"c06a3a88-4b60-4045-b794-e54e3d38068c\") " pod="openshift-ingress-canary/ingress-canary-tr6dv"
Oct 30 21:54:46.547514 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.547494    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f63cc71d-ab0b-4137-9cce-a1c780acfb09-serviceca\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:54:46.547563 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.547531    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-cni-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.547623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.547571    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3390fc0f-4489-4c05-b017-475fdb9c5670-cni-binary-copy\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.547623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.547610    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-hostroot\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.547799 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.547782    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-multus-certs\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.547860 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.547819    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:46.547945 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.547932    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-trusted-ca\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.547996 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.547946    5258 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 21:54:46.547996 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.547960    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntgj6\" (UniqueName: \"kubernetes.io/projected/60427449-1081-4049-a2e8-3665f4dbdd63-kube-api-access-ntgj6\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:46.548095 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548028    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-system-cni-dir\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.548095 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548055    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.548095 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548079    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysconfig\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.548237 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548107    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz52v\" (UniqueName: \"kubernetes.io/projected/28265d99-26ec-4182-a806-4aac326a4781-kube-api-access-hz52v\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.548237 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548126    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60427449-1081-4049-a2e8-3665f4dbdd63-serving-cert\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:46.548237 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548170    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-modprobe-d\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.548237 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548193    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-systemd\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.548237 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548207    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-lib-modules\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.548237 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548234    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44sns\" (UniqueName: \"kubernetes.io/projected/434e8ae7-f2c1-4195-a22e-366bf3290d79-kube-api-access-44sns\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:54:46.548516 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548274    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-cnibin\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.548516 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548407    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-k8s-cni-cncf-io\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.548516 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548458    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4nfk\" (UniqueName: \"kubernetes.io/projected/f63cc71d-ab0b-4137-9cce-a1c780acfb09-kube-api-access-z4nfk\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:54:46.548516 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548505    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysctl-d\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.548739 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548532    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.548739 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548541    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.548739 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548583    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.548739 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548609    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.548739 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548712    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-socket-dir-parent\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.548956 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548741    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk6wz\" (UniqueName: \"kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz\") pod \"network-check-target-6gnzt\" (UID: \"4110027a-d96e-4b82-8206-3f4c30cc5978\") " pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:46.548956 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548798    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/598df9f3-580f-4014-9abd-a9d84272f7d7-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:46.548956 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548835    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:46.548956 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548869    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.548956 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548875    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-daemon-config\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.548956 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548926    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-kubelet\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.549176 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548939    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.549176 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.548982    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-etc-kubernetes\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.549176 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549008    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-data-volume\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:46.549176 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549038    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:46.549176 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549073    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.549176 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549059    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txwb8\" (UniqueName: \"kubernetes.io/projected/8a9727e5-7f30-4be7-bc31-9a2af5b0d21e-kube-api-access-txwb8\") pod \"kas-connection-checker-685895c7c9-d9h59\" (UID: \"8a9727e5-7f30-4be7-bc31-9a2af5b0d21e\") " pod="kube-system/kas-connection-checker-685895c7c9-d9h59"
Oct 30 21:54:46.549176 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549116    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.549176 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549117    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-installation-pull-secrets\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.549176 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549163    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 21:54:46.549569 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549210    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-data-volume\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:46.549569 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549200    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60427449-1081-4049-a2e8-3665f4dbdd63-tmp\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:46.549569 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549252    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/434e8ae7-f2c1-4195-a22e-366bf3290d79-hosts-file\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:54:46.549569 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549285    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/416a5a6a-c3b4-460e-9382-4ed77d5ca406-nginx-conf\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:46.549569 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549314    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-system-cni-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.549569 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549342    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-crio-socket\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:46.549569 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549341    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60427449-1081-4049-a2e8-3665f4dbdd63-tmp\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:46.549569 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549396    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-tmp-dir\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:46.549569 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549453    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5981da65-938a-4058-b3cb-459025feb5d6-dbus\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:46.549569 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549483    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-tuned\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.549569 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549538    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-tmp-dir\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:46.549569 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549567    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.550050 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549585    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:46.550050 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549617    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/598df9f3-580f-4014-9abd-a9d84272f7d7-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:46.550050 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549644    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-tuned\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.550050 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549674    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vktq\" (UniqueName: \"kubernetes.io/projected/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-kube-api-access-8vktq\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:46.550050 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549737    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5981da65-938a-4058-b3cb-459025feb5d6-kubelet-config\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:46.550050 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549769    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/60427449-1081-4049-a2e8-3665f4dbdd63-snapshots\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:46.550050 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549813    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58eb124c-7ccc-43bf-89d9-72b023b94a27-tmp\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.550050 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549858    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-device-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.550050 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549872    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c06a3a88-4b60-4045-b794-e54e3d38068c-cert\") pod \"ingress-canary-tr6dv\" (UID: \"c06a3a88-4b60-4045-b794-e54e3d38068c\") " pod="openshift-ingress-canary/ingress-canary-tr6dv"
Oct 30 21:54:46.550050 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549906    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58eb124c-7ccc-43bf-89d9-72b023b94a27-tmp\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.550050 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549914    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgnbc\" (UniqueName: \"kubernetes.io/projected/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-api-access-lgnbc\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:46.550050 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.549934    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-image-registry-private-configuration\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.550050 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550019    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-var-lib-kubelet\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.550683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550180    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-cni-multus\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.550683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550219    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfwd8\" (UniqueName: \"kubernetes.io/projected/3390fc0f-4489-4c05-b017-475fdb9c5670-kube-api-access-sfwd8\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.550683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550262    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74zs2\" (UniqueName: \"kubernetes.io/projected/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-kube-api-access-74zs2\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:46.550683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550294    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 21:54:46.550683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550285    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/60427449-1081-4049-a2e8-3665f4dbdd63-snapshots\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:46.550683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550337    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.550683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550455    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.550683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550459    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 21:54:46.550683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550474    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.551073 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550635    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60427449-1081-4049-a2e8-3665f4dbdd63-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:46.551073 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550838    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l685p\" (UniqueName: \"kubernetes.io/projected/58eb124c-7ccc-43bf-89d9-72b023b94a27-kube-api-access-l685p\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.551073 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550881    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-socket-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.551073 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550719    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 21:54:46.551073 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.550945    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-registration-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.551454 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.551428    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-conf-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.551550 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.551532    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-config-volume\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:46.551746 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.551725    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rddz8\" (UniqueName: \"kubernetes.io/projected/6a89d9ac-d62b-42e4-934a-faaa4285277a-kube-api-access-rddz8\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:46.551939 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.551920    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.551994 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.551730    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 21:54:46.552038 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.552025    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 21:54:46.553239 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.553220    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 21:54:46.553287 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.553249    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.553336 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.553289    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-njrjg\""
Oct 30 21:54:46.553378 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.553348    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.553541 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.551732    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.553624 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.553556    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-kubernetes\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.553659 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.553624    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysctl-conf\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.553720 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.553701    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-netns\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.553769 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.553751    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-cni-bin\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.553840 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.553825    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:46.553898 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.553865    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhng5\" (UniqueName: \"kubernetes.io/projected/598df9f3-580f-4014-9abd-a9d84272f7d7-kube-api-access-qhng5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:46.553957 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.553938    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60427449-1081-4049-a2e8-3665f4dbdd63-service-ca-bundle\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:46.554019 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.554000    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-run\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.554069 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.554045    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-sys\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.554127 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.554083    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-host\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.554184 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.554154    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/434e8ae7-f2c1-4195-a22e-366bf3290d79-tmp-dir\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:54:46.554236 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.554190    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:46.554268 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.554242    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90c31b99-6613-479f-9e60-f028a1967dad-serving-cert\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:46.554879 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.554853    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/434e8ae7-f2c1-4195-a22e-366bf3290d79-tmp-dir\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:54:46.555916 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.555890    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60427449-1081-4049-a2e8-3665f4dbdd63-service-ca-bundle\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:46.556629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.556575    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 21:54:46.559407 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.559387    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:46.559492 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.559474    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/598df9f3-580f-4014-9abd-a9d84272f7d7-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:46.560524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.560508    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/598df9f3-580f-4014-9abd-a9d84272f7d7-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:46.561718 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.561702    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60427449-1081-4049-a2e8-3665f4dbdd63-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:46.594928 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.594877    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 21:54:46.596052 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.596036    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jwqz7\""
Oct 30 21:54:46.597935 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.597918    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wz9hq\""
Oct 30 21:54:46.597935 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.597920    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 21:54:46.598065 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.597975    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vlbqj\""
Oct 30 21:54:46.598065 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.598025    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 21:54:46.598065 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.598035    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rqktt\""
Oct 30 21:54:46.598065 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.598059    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2wsf2\""
Oct 30 21:54:46.598239 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.598093    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 21:54:46.598239 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.598123    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mkcm6\""
Oct 30 21:54:46.598239 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.598159    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 21:54:46.598239 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.598165    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.598374 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.598257    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 21:54:46.598374 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.598275    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.598522 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.598507    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/60427449-1081-4049-a2e8-3665f4dbdd63-serving-cert\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:46.611004 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.610982    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntgj6\" (UniqueName: \"kubernetes.io/projected/60427449-1081-4049-a2e8-3665f4dbdd63-kube-api-access-ntgj6\") pod \"insights-operator-7c4986d449-dglp8\" (UID: \"60427449-1081-4049-a2e8-3665f4dbdd63\") " pod="openshift-insights/insights-operator-7c4986d449-dglp8"
Oct 30 21:54:46.612683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.612663    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-bound-sa-token\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.612863 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.612845    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgnbc\" (UniqueName: \"kubernetes.io/projected/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-api-access-lgnbc\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:46.616197 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.616176    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txwb8\" (UniqueName: \"kubernetes.io/projected/8a9727e5-7f30-4be7-bc31-9a2af5b0d21e-kube-api-access-txwb8\") pod \"kas-connection-checker-685895c7c9-d9h59\" (UID: \"8a9727e5-7f30-4be7-bc31-9a2af5b0d21e\") " pod="kube-system/kas-connection-checker-685895c7c9-d9h59"
Oct 30 21:54:46.617748 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.617729    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhng5\" (UniqueName: \"kubernetes.io/projected/598df9f3-580f-4014-9abd-a9d84272f7d7-kube-api-access-qhng5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9\" (UID: \"598df9f3-580f-4014-9abd-a9d84272f7d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9"
Oct 30 21:54:46.617901 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.617884    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rddz8\" (UniqueName: \"kubernetes.io/projected/6a89d9ac-d62b-42e4-934a-faaa4285277a-kube-api-access-rddz8\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:46.649431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.649402    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 21:54:46.649524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.649449    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.649524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.649475    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 21:54:46.649524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.649495    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.649799 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.649416    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 21:54:46.649896 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.649796    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 21:54:46.649896 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.649410    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 21:54:46.650033 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.649914    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.650033 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.649944    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 21:54:46.650033 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.649958    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.650162 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.650041    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.650162 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.650064    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.650257 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.650237    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.650306 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.650253    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 21:54:46.650306 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.650258    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.650392 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.650330    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 21:54:46.650433 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.650412    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 21:54:46.650468 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.650457    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.650511 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.650457    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.650511 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.650507    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.650825 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.650804    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 21:54:46.650915 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.650834    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.650950 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.650908    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.650989 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.650930    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.651051 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.651033    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 21:54:46.651100 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.651085    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.651323 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.651286    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 21:54:46.651391 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.651334    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.651391 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.651368    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.651493 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.651388    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.651493 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.651439    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:54:46.651493 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.651490    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 21:54:46.651642 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.651623    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-474dq\""
Oct 30 21:54:46.651704 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.651674    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.651788 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.651774    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 21:54:46.651881 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.651868    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 21:54:46.651948 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.651928    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-config-volume\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:46.652049 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652035    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-26qpw\""
Oct 30 21:54:46.652161 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652147    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-vjl7c\""
Oct 30 21:54:46.652203 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652171    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-8jkh4\""
Oct 30 21:54:46.652239 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652203    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pgbrx\""
Oct 30 21:54:46.652239 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652215    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s9wtv\""
Oct 30 21:54:46.652239 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652218    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 21:54:46.652335 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652261    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t4xfw\""
Oct 30 21:54:46.652369 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652348    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 21:54:46.652412 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652385    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z7lww\""
Oct 30 21:54:46.652466 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652452    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 21:54:46.652530 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652516    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4dnxg\""
Oct 30 21:54:46.652579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652566    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 21:54:46.652646 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652602    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-66njg\""
Oct 30 21:54:46.652694 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652645    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:54:46.652743 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652723    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 21:54:46.652794 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652767    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 21:54:46.652844 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652808    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.652894 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652852    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-j4tgb\""
Oct 30 21:54:46.652953 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652910    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 21:54:46.653006 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652951    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 21:54:46.653006 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653000    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-fd64m\""
Oct 30 21:54:46.653110 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652995    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfwd8\" (UniqueName: \"kubernetes.io/projected/3390fc0f-4489-4c05-b017-475fdb9c5670-kube-api-access-sfwd8\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.653110 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.652810    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hbp5d\""
Oct 30 21:54:46.653110 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653049    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 21:54:46.653110 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653059    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vktq\" (UniqueName: \"kubernetes.io/projected/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-kube-api-access-8vktq\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:46.653110 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653081    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-c7qtj\""
Oct 30 21:54:46.653353 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653112    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l685p\" (UniqueName: \"kubernetes.io/projected/58eb124c-7ccc-43bf-89d9-72b023b94a27-kube-api-access-l685p\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.653353 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653116    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5khdr\""
Oct 30 21:54:46.653353 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653152    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk6wz\" (UniqueName: \"kubernetes.io/projected/4110027a-d96e-4b82-8206-3f4c30cc5978-kube-api-access-tk6wz\") pod \"network-check-target-6gnzt\" (UID: \"4110027a-d96e-4b82-8206-3f4c30cc5978\") " pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:46.653353 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653156    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:54:46.653353 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653227    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ghldd\""
Oct 30 21:54:46.653353 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653269    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 21:54:46.653353 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653318    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bmck6\""
Oct 30 21:54:46.653688 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653394    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 21:54:46.653688 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653431    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-plmg6\""
Oct 30 21:54:46.653688 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653470    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 21:54:46.653688 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653486    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5mdx\" (UniqueName: \"kubernetes.io/projected/318576c4-97c5-473c-9ea5-4a61c104f89f-kube-api-access-h5mdx\") pod \"network-check-source-6f78d59f99-rdsd9\" (UID: \"318576c4-97c5-473c-9ea5-4a61c104f89f\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-rdsd9"
Oct 30 21:54:46.653688 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653531    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hfjcw\""
Oct 30 21:54:46.653688 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.653630    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8zgsk\""
Oct 30 21:54:46.654613 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654597    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-run-netns\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.654657 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654638    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-device-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.654734 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654657    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-var-lib-kubelet\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.654734 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654675    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d85ad48-ac81-4f99-83d9-9e93db301d40-config\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:46.654734 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654701    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-socket-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.654880 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654741    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-var-lib-kubelet\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.654880 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654743    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-device-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.654880 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654755    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-ovn\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.654880 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654791    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-socket-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.654880 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654795    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovnkube-script-lib\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.654880 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654830    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-kubernetes\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.654880 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654839    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90c31b99-6613-479f-9e60-f028a1967dad-serving-cert\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:46.654880 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654876    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysctl-conf\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.655235 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654889    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-kubernetes\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.655235 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654919    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 21:54:46.655235 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654930    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-netns\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.655235 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.654962    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d85ad48-ac81-4f99-83d9-9e93db301d40-config\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:46.655235 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655024    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovnkube-script-lib\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.655235 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655048    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysctl-conf\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.655235 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655057    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-cni-bin\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.655235 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655077    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-netns\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.655235 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655078    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:46.655235 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655122    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8hdp\" (UniqueName: \"kubernetes.io/projected/fb977621-3d73-4a48-bc4c-a50f67da25d6-kube-api-access-d8hdp\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:46.655235 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655148    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-cni-bin\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.655235 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655196    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-etc-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.655629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655245    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-cni-bin\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.655629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655317    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-run\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.655629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655338    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-sys\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.655629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655345    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 21:54:46.655629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655351    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-host\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.655629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655389    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:46.655629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655395    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-sys\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.655629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655403    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-run\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.655629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655408    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.655629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655417    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-host\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.655629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655517    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2txv\" (UniqueName: \"kubernetes.io/projected/55811aff-113a-465d-9e99-0e4d78962934-kube-api-access-x2txv\") pod \"volume-data-source-validator-58c9f5f46d-wlt6w\" (UID: \"55811aff-113a-465d-9e99-0e4d78962934\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wlt6w"
Oct 30 21:54:46.655629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655579    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-cni-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.655629 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655625    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-var-lib-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655651    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655663    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-cni-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655677    5258 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655691    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655721    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655806    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d85ad48-ac81-4f99-83d9-9e93db301d40-serving-cert\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655835    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-node-log\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655855    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-run-ovn-kubernetes\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655877    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655904    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-modprobe-d\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655925    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-cnibin\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655940    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-log-socket\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655956    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.655980    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656001    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-modprobe-d\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656007    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-cnibin\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656002    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4nfk\" (UniqueName: \"kubernetes.io/projected/f63cc71d-ab0b-4137-9cce-a1c780acfb09-kube-api-access-z4nfk\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656011    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-stats-auth\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656039    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656051    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-systemd-units\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.656077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656078    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-etc-kubernetes\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656102    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d85ad48-ac81-4f99-83d9-9e93db301d40-serving-cert\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656104    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovnkube-config\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656153    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-crio-socket\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656169    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-env-overrides\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656173    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-etc-kubernetes\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656183    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5981da65-938a-4058-b3cb-459025feb5d6-dbus\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656218    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5981da65-938a-4058-b3cb-459025feb5d6-dbus\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656227    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656240    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-stats-auth\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656259    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-crio-socket\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656258    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-slash\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656277    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovnkube-config\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656291    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5981da65-938a-4058-b3cb-459025feb5d6-kubelet-config\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656305    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656344    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-default-certificate\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656354    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5981da65-938a-4058-b3cb-459025feb5d6-kubelet-config\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656369    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84f02cd4-68fb-43b2-bb98-86f2fd944aad-agent-certs\") pod \"konnectivity-agent-hjj9v\" (UID: \"84f02cd4-68fb-43b2-bb98-86f2fd944aad\") " pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656364    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b832e76-992a-4ff5-abe5-44ec22eba0d1-env-overrides\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656397    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhw4h\" (UniqueName: \"kubernetes.io/projected/2feb206d-12b1-4761-96e2-321878073139-kube-api-access-xhw4h\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656423    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-cni-multus\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656449    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d85ad48-ac81-4f99-83d9-9e93db301d40-trusted-ca\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656488    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656522    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-registration-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656548    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-conf-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656576    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-cni-netd\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656614    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-cni-multus\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656622    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjxm9\" (UniqueName: \"kubernetes.io/projected/391964ff-6e62-49e9-89ca-a11cc36d5753-kube-api-access-tjxm9\") pod \"kas-connection-checker-685895c7c9-bhpxt\" (UID: \"391964ff-6e62-49e9-89ca-a11cc36d5753\") " pod="kube-system/kas-connection-checker-685895c7c9-bhpxt"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656654    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn8t9\" (UniqueName: \"kubernetes.io/projected/368dc546-ddd5-4dfb-8b14-426e6084bd63-kube-api-access-xn8t9\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656663    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-conf-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.656683 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656683    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f63cc71d-ab0b-4137-9cce-a1c780acfb09-host\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656708    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmdfr\" (UniqueName: \"kubernetes.io/projected/9d85ad48-ac81-4f99-83d9-9e93db301d40-kube-api-access-tmdfr\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656731    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-registration-dir\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656741    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-sys-fs\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656770    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84f02cd4-68fb-43b2-bb98-86f2fd944aad-agent-certs\") pod \"konnectivity-agent-hjj9v\" (UID: \"84f02cd4-68fb-43b2-bb98-86f2fd944aad\") " pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656770    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2feb206d-12b1-4761-96e2-321878073139-iptables-alerter-script\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656804    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-hostroot\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656820    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-multus-certs\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656838    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656855    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656883    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovn-node-metrics-cert\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656900    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-system-cni-dir\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656917    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kjq8\" (UniqueName: \"kubernetes.io/projected/1f4fae7b-7758-422b-9271-451c4904c76e-kube-api-access-6kjq8\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656548    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-default-certificate\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656935    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2feb206d-12b1-4761-96e2-321878073139-iptables-alerter-script\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.656941    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.657180    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.657636 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.657259    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28265d99-26ec-4182-a806-4aac326a4781-sys-fs\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.657690    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b832e76-992a-4ff5-abe5-44ec22eba0d1-ovn-node-metrics-cert\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.657739    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44sns\" (UniqueName: \"kubernetes.io/projected/434e8ae7-f2c1-4195-a22e-366bf3290d79-kube-api-access-44sns\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.657754    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-system-cni-dir\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.657943    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5981da65-938a-4058-b3cb-459025feb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-2hjmh\" (UID: \"5981da65-938a-4058-b3cb-459025feb5d6\") " pod="kube-system/global-pull-secret-syncer-2hjmh"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658023    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d85ad48-ac81-4f99-83d9-9e93db301d40-trusted-ca\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658115    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f9c30fb-c07a-4566-8f99-7ddb1ee9da13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s6x2r\" (UID: \"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13\") " pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658156    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-hostroot\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658161    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f63cc71d-ab0b-4137-9cce-a1c780acfb09-host\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658116    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90c31b99-6613-479f-9e60-f028a1967dad-config\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658173    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3390fc0f-4489-4c05-b017-475fdb9c5670-cni-binary-copy\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658190    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysconfig\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658195    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-multus-certs\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658222    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658227    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysconfig\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658250    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-systemd\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658275    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658302    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-systemd\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658328    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-lib-modules\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658351    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-k8s-cni-cncf-io\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658380    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-kubelet\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658426    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-run-k8s-cni-cncf-io\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.658431 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658427    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg5j8\" (UniqueName: \"kubernetes.io/projected/4b832e76-992a-4ff5-abe5-44ec22eba0d1-kube-api-access-jg5j8\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658460    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2feb206d-12b1-4761-96e2-321878073139-host-slash\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658501    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysctl-d\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658518    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzcwv\" (UniqueName: \"kubernetes.io/projected/e333b33a-d003-4886-83f5-6f1534ca8699-kube-api-access-mzcwv\") pod \"migrator-66df5d496b-jdpbb\" (UID: \"e333b33a-d003-4886-83f5-6f1534ca8699\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-jdpbb"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658527    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-socket-dir-parent\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658602    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-cnibin\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658638    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84f02cd4-68fb-43b2-bb98-86f2fd944aad-konnectivity-ca\") pod \"konnectivity-agent-hjj9v\" (UID: \"84f02cd4-68fb-43b2-bb98-86f2fd944aad\") " pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658665    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-systemd\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658667    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658744    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-socket-dir-parent\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658782    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-lib-modules\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658834    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58eb124c-7ccc-43bf-89d9-72b023b94a27-etc-sysctl-d\") pod \"tuned-kw6b8\" (UID: \"58eb124c-7ccc-43bf-89d9-72b023b94a27\") " pod="openshift-cluster-node-tuning-operator/tuned-kw6b8"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658860    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zkbx\" (UniqueName: \"kubernetes.io/projected/90c31b99-6613-479f-9e60-f028a1967dad-kube-api-access-8zkbx\") pod \"service-ca-operator-544d749c8c-lv9j7\" (UID: \"90c31b99-6613-479f-9e60-f028a1967dad\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658866    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftbtr\" (UniqueName: \"kubernetes.io/projected/b7d2b389-602c-4ef9-a4eb-2caf80e330d0-kube-api-access-ftbtr\") pod \"kas-connection-checker-685895c7c9-x9kk6\" (UID: \"b7d2b389-602c-4ef9-a4eb-2caf80e330d0\") " pod="kube-system/kas-connection-checker-685895c7c9-x9kk6"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658895    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-kubelet\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.658945    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/368dc546-ddd5-4dfb-8b14-426e6084bd63-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.659057    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84f02cd4-68fb-43b2-bb98-86f2fd944aad-konnectivity-ca\") pod \"konnectivity-agent-hjj9v\" (UID: \"84f02cd4-68fb-43b2-bb98-86f2fd944aad\") " pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.659101    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-host-var-lib-kubelet\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.659137    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1f4fae7b-7758-422b-9271-451c4904c76e-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.659237    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f63cc71d-ab0b-4137-9cce-a1c780acfb09-serviceca\") pod \"node-ca-p97r6\" (UID: \"f63cc71d-ab0b-4137-9cce-a1c780acfb09\") " pod="openshift-image-registry/node-ca-p97r6"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.659233    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/434e8ae7-f2c1-4195-a22e-366bf3290d79-hosts-file\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.659285    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-system-cni-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.659373    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3390fc0f-4489-4c05-b017-475fdb9c5670-system-cni-dir\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.659383    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3390fc0f-4489-4c05-b017-475fdb9c5670-multus-daemon-config\") pod \"multus-cs98z\" (UID: \"3390fc0f-4489-4c05-b017-475fdb9c5670\") " pod="openshift-multus/multus-cs98z"
Oct 30 21:54:46.659449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.659421    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/434e8ae7-f2c1-4195-a22e-366bf3290d79-hosts-file\") pod \"node-resolver-bvgp5\" (UID: \"434e8ae7-f2c1-4195-a22e-366bf3290d79\") " pod="openshift-dns/node-resolver-bvgp5"
Oct 30 21:54:46.660523 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.659647    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1f4fae7b-7758-422b-9271-451c4904c76e-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:46.660523 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.659737    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-installation-pull-secrets\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.660523 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.659856    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a89d9ac-d62b-42e4-934a-faaa4285277a-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-t4r5j\" (UID: \"6a89d9ac-d62b-42e4-934a-faaa4285277a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:46.660523 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.660045    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/416a5a6a-c3b4-460e-9382-4ed77d5ca406-nginx-conf\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:46.660523 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.660211    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-metrics-tls\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:46.660523 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.660351    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-trusted-ca\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.660523 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.660392    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-certificates\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.660523 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.660461    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh7z8\" (UniqueName: \"kubernetes.io/projected/c06a3a88-4b60-4045-b794-e54e3d38068c-kube-api-access-bh7z8\") pod \"ingress-canary-tr6dv\" (UID: \"c06a3a88-4b60-4045-b794-e54e3d38068c\") " pod="openshift-ingress-canary/ingress-canary-tr6dv"
Oct 30 21:54:46.660931 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.660574    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a5aacf3-197a-4725-b9ae-a0d0f11888e7-metrics-certs\") pod \"network-metrics-daemon-xpf4w\" (UID: \"1a5aacf3-197a-4725-b9ae-a0d0f11888e7\") " pod="openshift-multus/network-metrics-daemon-xpf4w"
Oct 30 21:54:46.660931 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.660636    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-image-registry-private-configuration\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.660931 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.660815    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c06a3a88-4b60-4045-b794-e54e3d38068c-cert\") pod \"ingress-canary-tr6dv\" (UID: \"c06a3a88-4b60-4045-b794-e54e3d38068c\") " pod="openshift-ingress-canary/ingress-canary-tr6dv"
Oct 30 21:54:46.660931 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.660857    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz52v\" (UniqueName: \"kubernetes.io/projected/28265d99-26ec-4182-a806-4aac326a4781-kube-api-access-hz52v\") pod \"aws-ebs-csi-driver-node-9rnz9\" (UID: \"28265d99-26ec-4182-a806-4aac326a4781\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rnz9"
Oct 30 21:54:46.660931 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.660858    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74zs2\" (UniqueName: \"kubernetes.io/projected/4a4f3ab5-fba1-457f-bd3f-2d760bf6372c-kube-api-access-74zs2\") pod \"dns-default-rbmtp\" (UID: \"4a4f3ab5-fba1-457f-bd3f-2d760bf6372c\") " pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:46.661067 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.661006    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.661664 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.661640    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416a5a6a-c3b4-460e-9382-4ed77d5ca406-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-bj87t\" (UID: \"416a5a6a-c3b4-460e-9382-4ed77d5ca406\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:46.662976 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.662957    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb6hh\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-kube-api-access-zb6hh\") pod \"image-registry-5b9c975d75-kkjl6\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") " pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.715317 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.715290    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2txv\" (UniqueName: \"kubernetes.io/projected/55811aff-113a-465d-9e99-0e4d78962934-kube-api-access-x2txv\") pod \"volume-data-source-validator-58c9f5f46d-wlt6w\" (UID: \"55811aff-113a-465d-9e99-0e4d78962934\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-wlt6w"
Oct 30 21:54:46.715721 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.715700    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhw4h\" (UniqueName: \"kubernetes.io/projected/2feb206d-12b1-4761-96e2-321878073139-kube-api-access-xhw4h\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:54:46.715954 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.715929    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8hdp\" (UniqueName: \"kubernetes.io/projected/fb977621-3d73-4a48-bc4c-a50f67da25d6-kube-api-access-d8hdp\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:46.716139 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.716115    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjxm9\" (UniqueName: \"kubernetes.io/projected/391964ff-6e62-49e9-89ca-a11cc36d5753-kube-api-access-tjxm9\") pod \"kas-connection-checker-685895c7c9-bhpxt\" (UID: \"391964ff-6e62-49e9-89ca-a11cc36d5753\") " pod="kube-system/kas-connection-checker-685895c7c9-bhpxt"
Oct 30 21:54:46.716306 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.716291    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmdfr\" (UniqueName: \"kubernetes.io/projected/9d85ad48-ac81-4f99-83d9-9e93db301d40-kube-api-access-tmdfr\") pod \"console-operator-7cd56b8dbc-57lx9\" (UID: \"9d85ad48-ac81-4f99-83d9-9e93db301d40\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:46.720559 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.717785    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn8t9\" (UniqueName: \"kubernetes.io/projected/368dc546-ddd5-4dfb-8b14-426e6084bd63-kube-api-access-xn8t9\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.720559 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.718345    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg5j8\" (UniqueName: \"kubernetes.io/projected/4b832e76-992a-4ff5-abe5-44ec22eba0d1-kube-api-access-jg5j8\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.720559 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.718490    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftbtr\" (UniqueName: \"kubernetes.io/projected/b7d2b389-602c-4ef9-a4eb-2caf80e330d0-kube-api-access-ftbtr\") pod \"kas-connection-checker-685895c7c9-x9kk6\" (UID: \"b7d2b389-602c-4ef9-a4eb-2caf80e330d0\") " pod="kube-system/kas-connection-checker-685895c7c9-x9kk6"
Oct 30 21:54:46.720559 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.718681    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kjq8\" (UniqueName: \"kubernetes.io/projected/1f4fae7b-7758-422b-9271-451c4904c76e-kube-api-access-6kjq8\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:46.759992 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.759973    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.760051 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760002    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-var-lib-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760051 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760023    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760051 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760040    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:46.760187 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760056    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-node-log\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760187 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760076    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-run-ovn-kubernetes\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760187 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760089    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-var-lib-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760187 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760099    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-log-socket\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760187 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760125    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760187 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760127    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.760187 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760132    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-log-socket\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760187 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760140    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:46.760187 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760167    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-run-ovn-kubernetes\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760188    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-node-log\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760199    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-systemd-units\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760224    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-systemd-units\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760231    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-slash\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760261    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-slash\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760282    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760302    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-cni-netd\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760338    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-systemd\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760362    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760389    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-kubelet\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760390    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-cni-netd\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760389    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-systemd\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760424    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2feb206d-12b1-4761-96e2-321878073139-host-slash\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760439    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-kubelet\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760446    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760454    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-cnibin\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760476    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2feb206d-12b1-4761-96e2-321878073139-host-slash\") pod \"iptables-alerter-9wkj7\" (UID: \"2feb206d-12b1-4761-96e2-321878073139\") " pod="openshift-network-operator/iptables-alerter-9wkj7"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760486    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-run-netns\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760515    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/368dc546-ddd5-4dfb-8b14-426e6084bd63-cnibin\") pod \"multus-additional-cni-plugins-z4222\" (UID: \"368dc546-ddd5-4dfb-8b14-426e6084bd63\") " pod="openshift-multus/multus-additional-cni-plugins-z4222"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760516    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-ovn\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760553    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-etc-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760551    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-run-netns\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760622    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-etc-openvswitch\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.760623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760621    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-cni-bin\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.761453 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760650    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-host-cni-bin\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.761453 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760552    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b832e76-992a-4ff5-abe5-44ec22eba0d1-run-ovn\") pod \"ovnkube-node-nbrqj\" (UID: \"4b832e76-992a-4ff5-abe5-44ec22eba0d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:46.761453 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.760925    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb977621-3d73-4a48-bc4c-a50f67da25d6-service-ca-bundle\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:46.762269 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.762246    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb977621-3d73-4a48-bc4c-a50f67da25d6-metrics-certs\") pod \"router-default-5c6c4f6cbf-rnprt\" (UID: \"fb977621-3d73-4a48-bc4c-a50f67da25d6\") " pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:46.762464 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.762447    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f4fae7b-7758-422b-9271-451c4904c76e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-qvvd7\" (UID: \"1f4fae7b-7758-422b-9271-451c4904c76e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:46.790905 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.790885    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"
Oct 30 21:54:46.794649 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.794635    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"
Oct 30 21:54:46.794879 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.794858    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:46.795692 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.795661    5258 scope.go:122] "RemoveContainer" containerID="23fcb3fb2dc40787e1e84b1059abcc8262c503e3dc64169257f2b25d4c114dda"
Oct 30 21:54:46.796811 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.796797    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t"
Oct 30 21:54:46.802994 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.802974    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:46.804655 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:46.804634    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s6x2r"
Oct 30 21:54:47.256248 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.256173    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7"]
Oct 30 21:54:47.259793 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:47.259766    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4fae7b_7758_422b_9271_451c4904c76e.slice/crio-8e851d0222063a2998f291c9d941e90c36842f26c891c496dcae28b4d22189b0 WatchSource:0}: Error finding container 8e851d0222063a2998f291c9d941e90c36842f26c891c496dcae28b4d22189b0: Status 404 returned error can't find the container with id 8e851d0222063a2998f291c9d941e90c36842f26c891c496dcae28b4d22189b0
Oct 30 21:54:47.261997 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.261978    5258 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:54:47.289154 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.289018    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-bj87t"]
Oct 30 21:54:47.290325 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.290303    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j"]
Oct 30 21:54:47.295764 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:47.295741    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416a5a6a_c3b4_460e_9382_4ed77d5ca406.slice/crio-e06c3448ec3d949a9d505c3efbace2e894f94f3c99c07a26751a1ffe36f83e7e WatchSource:0}: Error finding container e06c3448ec3d949a9d505c3efbace2e894f94f3c99c07a26751a1ffe36f83e7e: Status 404 returned error can't find the container with id e06c3448ec3d949a9d505c3efbace2e894f94f3c99c07a26751a1ffe36f83e7e
Oct 30 21:54:47.300405 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.298973    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5c6c4f6cbf-rnprt"]
Oct 30 21:54:47.309709 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.309688    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b9c975d75-kkjl6"]
Oct 30 21:54:47.310070 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:47.310050    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb977621_3d73_4a48_bc4c_a50f67da25d6.slice/crio-a2f71aa247c2eb846e37be6d320d7e0bbcacbe0b0e15f2679d0991c329b2de48 WatchSource:0}: Error finding container a2f71aa247c2eb846e37be6d320d7e0bbcacbe0b0e15f2679d0991c329b2de48: Status 404 returned error can't find the container with id a2f71aa247c2eb846e37be6d320d7e0bbcacbe0b0e15f2679d0991c329b2de48
Oct 30 21:54:47.315011 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:47.314989    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf5df1af_34a5_4168_9f99_b1e8319f6f2b.slice/crio-a93bbca4cfb31acc69093e78798481b6526b4be894c096571d3697e1890413ff WatchSource:0}: Error finding container a93bbca4cfb31acc69093e78798481b6526b4be894c096571d3697e1890413ff: Status 404 returned error can't find the container with id a93bbca4cfb31acc69093e78798481b6526b4be894c096571d3697e1890413ff
Oct 30 21:54:47.342767 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.342741    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s6x2r"]
Oct 30 21:54:47.346961 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:54:47.346931    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f9c30fb_c07a_4566_8f99_7ddb1ee9da13.slice/crio-aeb9005d675e45da479d47923775d330d9746b99048aa7a69f59b324b53f6800 WatchSource:0}: Error finding container aeb9005d675e45da479d47923775d330d9746b99048aa7a69f59b324b53f6800: Status 404 returned error can't find the container with id aeb9005d675e45da479d47923775d330d9746b99048aa7a69f59b324b53f6800
Oct 30 21:54:47.363390 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.363299    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:54:47.381604 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.381564    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9703e4a3-5da9-4c15-9f8d-2855f39f0808" path="/var/lib/kubelet/pods/9703e4a3-5da9-4c15-9f8d-2855f39f0808/volumes"
Oct 30 21:54:47.443549 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.443497    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt" event={"ID":"fb977621-3d73-4a48-bc4c-a50f67da25d6","Type":"ContainerStarted","Data":"0b0e8eec8dfc50757174f1002958d16e04a99b6d1aa3e666946dbb7433183ef2"}
Oct 30 21:54:47.443729 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.443628    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt" event={"ID":"fb977621-3d73-4a48-bc4c-a50f67da25d6","Type":"ContainerStarted","Data":"a2f71aa247c2eb846e37be6d320d7e0bbcacbe0b0e15f2679d0991c329b2de48"}
Oct 30 21:54:47.446212 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.446187    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s6x2r" event={"ID":"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13","Type":"ContainerStarted","Data":"dde02dc9d24aacfbc9ae2efaaf91a32bd92d9e28494977307571c8e00c96e43d"}
Oct 30 21:54:47.446429 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.446234    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s6x2r" event={"ID":"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13","Type":"ContainerStarted","Data":"aeb9005d675e45da479d47923775d330d9746b99048aa7a69f59b324b53f6800"}
Oct 30 21:54:47.447603 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.447565    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6" event={"ID":"cf5df1af-34a5-4168-9f99-b1e8319f6f2b","Type":"ContainerStarted","Data":"a21ff6c1e7fde6e29bb6eb0982554eb956dd0f5166832724cbaa1c2c5cdf42cc"}
Oct 30 21:54:47.447697 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.447628    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6" event={"ID":"cf5df1af-34a5-4168-9f99-b1e8319f6f2b","Type":"ContainerStarted","Data":"a93bbca4cfb31acc69093e78798481b6526b4be894c096571d3697e1890413ff"}
Oct 30 21:54:47.449322 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.449293    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7" event={"ID":"1f4fae7b-7758-422b-9271-451c4904c76e","Type":"ContainerStarted","Data":"8e851d0222063a2998f291c9d941e90c36842f26c891c496dcae28b4d22189b0"}
Oct 30 21:54:47.451725 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.451704    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 21:54:47.451847 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.451818    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9" event={"ID":"9d85ad48-ac81-4f99-83d9-9e93db301d40","Type":"ContainerStarted","Data":"28ab81a68ba628158d7e9228f924a1920e20b0a3fc9f6761c62130053bc6183b"}
Oct 30 21:54:47.453829 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.453806    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t" event={"ID":"416a5a6a-c3b4-460e-9382-4ed77d5ca406","Type":"ContainerStarted","Data":"e06c3448ec3d949a9d505c3efbace2e894f94f3c99c07a26751a1ffe36f83e7e"}
Oct 30 21:54:47.454993 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.454971    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j" event={"ID":"6a89d9ac-d62b-42e4-934a-faaa4285277a","Type":"ContainerStarted","Data":"ee45e7189fc6915c20bcaa03ebf75221010eaa7639ac8a4ae885d87a0fa8e9a8"}
Oct 30 21:54:47.636261 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.636215    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:47.795502 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.795466    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:47.798612 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.798016    5258 patch_prober.go:29] interesting pod/router-default-5c6c4f6cbf-rnprt container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld
Oct 30 21:54:47.798612 ip-10-0-137-32 kubenswrapper[5258]: [+]has-synced ok
Oct 30 21:54:47.798612 ip-10-0-137-32 kubenswrapper[5258]: [+]process-running ok
Oct 30 21:54:47.798612 ip-10-0-137-32 kubenswrapper[5258]: healthz check failed
Oct 30 21:54:47.798612 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:47.798099    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt" podUID="fb977621-3d73-4a48-bc4c-a50f67da25d6" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Oct 30 21:54:48.460302 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:48.460246    5258 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:54:48.551231 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:48.551204    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rbmtp"
Oct 30 21:54:48.663049 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:48.662937    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:48.796555 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:48.796485    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:48.940893 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:48.940859    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:49.236993 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:49.236959    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:49.468764 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:49.468688    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s6x2r" event={"ID":"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13","Type":"ContainerStarted","Data":"ac7063eaff95e16c5c781257bf32c5d04bc4491e7e4dcebd1238bdb0507825c5"}
Oct 30 21:54:49.470859 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:49.470831    5258 generic.go:356] "Generic (PLEG): container finished" podID="60427449-1081-4049-a2e8-3665f4dbdd63" containerID="36aafe4f25c45828bd377bcb5cad3ea386e9d2c6f4bd85049162d7c95d882de9" exitCode=0
Oct 30 21:54:49.471008 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:49.470923    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-dglp8" event={"ID":"60427449-1081-4049-a2e8-3665f4dbdd63","Type":"ContainerDied","Data":"36aafe4f25c45828bd377bcb5cad3ea386e9d2c6f4bd85049162d7c95d882de9"}
Oct 30 21:54:49.471461 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:49.471443    5258 scope.go:122] "RemoveContainer" containerID="36aafe4f25c45828bd377bcb5cad3ea386e9d2c6f4bd85049162d7c95d882de9"
Oct 30 21:54:49.472702 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:49.472679    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:49.475011 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:49.474212    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-bj87t" event={"ID":"416a5a6a-c3b4-460e-9382-4ed77d5ca406","Type":"ContainerStarted","Data":"254818e7f8e64ef2e978087413d0b16739a9bfad917026b9a536fed93d74c030"}
Oct 30 21:54:49.969142 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:49.969115    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:50.199403 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:50.199343    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:50.479256 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:50.479232    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-dglp8" event={"ID":"60427449-1081-4049-a2e8-3665f4dbdd63","Type":"ContainerStarted","Data":"4152a4b91040dde3b2855a48aadade6289f8495506f1d3842effce956263b176"}
Oct 30 21:54:50.480762 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:50.480734    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-qvvd7" event={"ID":"1f4fae7b-7758-422b-9271-451c4904c76e","Type":"ContainerStarted","Data":"d3bd9cf31271a3095631facf165a67bc627ee5d0d2572f44d23aaae7ad99a1c2"}
Oct 30 21:54:50.482179 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:50.482157    5258 generic.go:356] "Generic (PLEG): container finished" podID="598df9f3-580f-4014-9abd-a9d84272f7d7" containerID="3958ec64ede0b5869c614cc139fb94165a34cf74f53be0e4173f6610f9359c9c" exitCode=0
Oct 30 21:54:50.482285 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:50.482228    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9" event={"ID":"598df9f3-580f-4014-9abd-a9d84272f7d7","Type":"ContainerDied","Data":"3958ec64ede0b5869c614cc139fb94165a34cf74f53be0e4173f6610f9359c9c"}
Oct 30 21:54:50.482559 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:50.482544    5258 scope.go:122] "RemoveContainer" containerID="3958ec64ede0b5869c614cc139fb94165a34cf74f53be0e4173f6610f9359c9c"
Oct 30 21:54:50.484037 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:50.484003    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j" event={"ID":"6a89d9ac-d62b-42e4-934a-faaa4285277a","Type":"ContainerStarted","Data":"1efa3f714cce4366444848cbac5ac62d8290621a93a2b37de2f9e164d82df13d"}
Oct 30 21:54:50.484136 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:50.484058    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-t4r5j" event={"ID":"6a89d9ac-d62b-42e4-934a-faaa4285277a","Type":"ContainerStarted","Data":"59d9dbd77ded70485f65c2282e08aa05388d5aa8abc60452626155cbe0c08781"}
Oct 30 21:54:50.485706 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:50.485686    5258 generic.go:356] "Generic (PLEG): container finished" podID="90c31b99-6613-479f-9e60-f028a1967dad" containerID="52f58ddb185dfb372aab0387143bf153a453213eec2a6ea03de6c777daae347d" exitCode=0
Oct 30 21:54:50.485812 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:50.485763    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7" event={"ID":"90c31b99-6613-479f-9e60-f028a1967dad","Type":"ContainerDied","Data":"52f58ddb185dfb372aab0387143bf153a453213eec2a6ea03de6c777daae347d"}
Oct 30 21:54:50.485922 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:50.485904    5258 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:54:50.486138 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:50.486120    5258 scope.go:122] "RemoveContainer" containerID="52f58ddb185dfb372aab0387143bf153a453213eec2a6ea03de6c777daae347d"
Oct 30 21:54:51.241347 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:51.241320    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:51.337765 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:51.337737    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:54:51.492127 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:51.491787    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s6x2r" event={"ID":"9f9c30fb-c07a-4566-8f99-7ddb1ee9da13","Type":"ContainerStarted","Data":"f5ba8745b6caad05b34b94ef8442f930ae5b07cf2c681c647527c398cb48768f"}
Oct 30 21:54:51.494070 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:51.494039    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dx5k9" event={"ID":"598df9f3-580f-4014-9abd-a9d84272f7d7","Type":"ContainerStarted","Data":"eed23b0d769b4c56b4c7b31c3c15245fecf73e57fc64937dc1a4500cf7d59f8e"}
Oct 30 21:54:51.495815 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:51.495794    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lv9j7" event={"ID":"90c31b99-6613-479f-9e60-f028a1967dad","Type":"ContainerStarted","Data":"3778ddfaf9de40484374b9fc994592e1bb2e77f4663c7e46464e88b83a3ab3a4"}
Oct 30 21:54:51.509421 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:51.509389    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:52.260506 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:52.260474    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:52.260761 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:52.260744    5258 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:54:52.352783 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:52.352750    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:52.452709 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:52.452683    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:52.452869 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:52.452838    5258 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:54:52.457238 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:52.457216    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-57lx9"
Oct 30 21:54:52.647893 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:52.647851    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:54.201854 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:54.201815    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:54.467565 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:54.467476    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:55.472524 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:55.472498    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:55.473011 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:55.472640    5258 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:54:55.473771 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:55.473749    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5c6c4f6cbf-rnprt"
Oct 30 21:54:55.791884 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:55.791793    5258 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-32.us-west-1.compute.internal" event="NodeReady"
Oct 30 21:54:56.135472 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:56.135435    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:56.350728 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:56.350692    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:56.607205 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:56.607161    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:56.748049 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:56.748018    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nbrqj"
Oct 30 21:54:56.851970 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:56.851938    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:57.079855 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:57.079821    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:59.406546 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:59.406506    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:59.669468 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:54:59.669366    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:02.329044 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:02.329008    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:03.024182 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.024145    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:03.246968 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.246935    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:03.468209 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.468169    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:03.690062 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.690033    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:03.701191 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.701164    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bvq68"]
Oct 30 21:55:03.704077 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.704060    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.780156 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.780099    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 21:55:03.802563 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.802534    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-textfile\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.802675 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.802578    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-root\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.802675 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.802612    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-metrics-client-ca\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.802751 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.802716    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.802792 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.802752    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwnth\" (UniqueName: \"kubernetes.io/projected/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-kube-api-access-rwnth\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.802792 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.802774    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-tls\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.802853 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.802830    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-sys\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.802894 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.802863    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-wtmp\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.802894 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.802880    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.806070 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.806053    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 21:55:03.829579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.829555    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 21:55:03.855398 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.855382    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-szz58\""
Oct 30 21:55:03.855492 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.855408    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 21:55:03.903855 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.903831    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-root\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.903942 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.903859    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-metrics-client-ca\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.903942 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.903882    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.904018 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.903947    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-root\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.904018 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.903998    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwnth\" (UniqueName: \"kubernetes.io/projected/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-kube-api-access-rwnth\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.904103 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.904042    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-tls\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.904103 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.904076    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-sys\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.904103 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.904094    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-wtmp\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.904243 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.904110    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.904243 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.904168    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-textfile\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.904243 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.904175    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-sys\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.904384 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.904283    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-wtmp\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.904458 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.904432    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-accelerators-collector-config\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.904502 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.904456    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-textfile\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.904502 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.904484    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-metrics-client-ca\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.906422 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.906400    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.906516 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.906379    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-node-exporter-tls\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:03.910078 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.910044    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:03.965772 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:03.965749    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwnth\" (UniqueName: \"kubernetes.io/projected/b59f60e7-6f19-45d0-a0f3-8c7b4da00298-kube-api-access-rwnth\") pod \"node-exporter-bvq68\" (UID: \"b59f60e7-6f19-45d0-a0f3-8c7b4da00298\") " pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:04.016432 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:04.016409    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bvq68"
Oct 30 21:55:04.028438 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:55:04.028411    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb59f60e7_6f19_45d0_a0f3_8c7b4da00298.slice/crio-7a86bc72761a134ef2c5ed5311a901975d961e4ea6de7499c9fd6830027032b8 WatchSource:0}: Error finding container 7a86bc72761a134ef2c5ed5311a901975d961e4ea6de7499c9fd6830027032b8: Status 404 returned error can't find the container with id 7a86bc72761a134ef2c5ed5311a901975d961e4ea6de7499c9fd6830027032b8
Oct 30 21:55:04.166575 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:04.166533    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:04.425397 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:04.425348    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:04.542415 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:04.542383    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvq68" event={"ID":"b59f60e7-6f19-45d0-a0f3-8c7b4da00298","Type":"ContainerStarted","Data":"7a86bc72761a134ef2c5ed5311a901975d961e4ea6de7499c9fd6830027032b8"}
Oct 30 21:55:05.087188 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:05.087149    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:05.348389 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:05.348301    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:05.934500 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:05.934469    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:06.399798 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:06.399764    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:06.551505 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:06.551459    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvq68" event={"ID":"b59f60e7-6f19-45d0-a0f3-8c7b4da00298","Type":"ContainerStarted","Data":"8da58b6efb9c50cc7b9a317276ea313269993c12f4f275252f3cf9215d1bdbd0"}
Oct 30 21:55:06.622240 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:06.622206    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:06.715726 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:06.715666    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hjj9v"
Oct 30 21:55:07.433968 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:07.433936    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b9c975d75-kkjl6"]
Oct 30 21:55:07.438097 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:07.438072    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:55:07.556292 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:07.556260    5258 generic.go:356] "Generic (PLEG): container finished" podID="b59f60e7-6f19-45d0-a0f3-8c7b4da00298" containerID="8da58b6efb9c50cc7b9a317276ea313269993c12f4f275252f3cf9215d1bdbd0" exitCode=0
Oct 30 21:55:07.556432 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:07.556356    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvq68" event={"ID":"b59f60e7-6f19-45d0-a0f3-8c7b4da00298","Type":"ContainerDied","Data":"8da58b6efb9c50cc7b9a317276ea313269993c12f4f275252f3cf9215d1bdbd0"}
Oct 30 21:55:07.618562 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:07.618531    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:07.833971 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:07.833893    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:08.092819 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:08.092739    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:08.322977 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:08.322945    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:08.563015 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:08.562988    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvq68" event={"ID":"b59f60e7-6f19-45d0-a0f3-8c7b4da00298","Type":"ContainerStarted","Data":"ce4fd232e5b1a6cc0451cd908ba1d6a0634899e764caf96218427d3e609f4188"}
Oct 30 21:55:08.563567 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:08.563539    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bvq68" event={"ID":"b59f60e7-6f19-45d0-a0f3-8c7b4da00298","Type":"ContainerStarted","Data":"91d180c8048cf27be4ee4f58a4b0ba755ffe6071d536036e4abbc2d3bdafb40b"}
Oct 30 21:55:08.563567 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:08.563071    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:08.687495 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:08.687439    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bvq68" podStartSLOduration=3.204999448 podStartE2EDuration="5.687425442s" totalImagesPullingTime="2.413478111s" totalInitContainerRuntime="68.947883ms" isStatefulPod=true podCreationTimestamp="2026-10-30 21:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:55:08.686993706 +0000 UTC m=+23.417850848" watchObservedRunningTime="2026-10-30 21:55:08.687425442 +0000 UTC m=+23.418282607"
Oct 30 21:55:08.798267 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:08.798229    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:12.912412 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:12.912374    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:13.134201 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:13.134170    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:13.160265 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:55:13.160225    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 21:55:13.382907 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:13.382872    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:15.210204 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:15.210171    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:15.476296 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:15.476212    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:17.458153 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:17.458125    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6gnzt"
Oct 30 21:55:17.699006 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:17.698971    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:17.960568 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:17.960535    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:20.836025 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:20.835985    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:21.068303 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:21.068266    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:25.285163 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:25.285123    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:25.546972 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:25.546894    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:29.392849 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:29.392812    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:29.627569 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:29.627533    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:32.042298 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.042262    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:32.453373 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.453339    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6" podUID="cf5df1af-34a5-4168-9f99-b1e8319f6f2b" containerName="registry" containerID="cri-o://a21ff6c1e7fde6e29bb6eb0982554eb956dd0f5166832724cbaa1c2c5cdf42cc" gracePeriod=30
Oct 30 21:55:32.651454 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.651425    5258 generic.go:356] "Generic (PLEG): container finished" podID="cf5df1af-34a5-4168-9f99-b1e8319f6f2b" containerID="a21ff6c1e7fde6e29bb6eb0982554eb956dd0f5166832724cbaa1c2c5cdf42cc" exitCode=0
Oct 30 21:55:32.651616 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.651500    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6" event={"ID":"cf5df1af-34a5-4168-9f99-b1e8319f6f2b","Type":"ContainerDied","Data":"a21ff6c1e7fde6e29bb6eb0982554eb956dd0f5166832724cbaa1c2c5cdf42cc"}
Oct 30 21:55:32.711250 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.707682    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:55:32.718101 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.718068    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:32.817626 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.817578    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-ca-trust-extracted\") pod \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") "
Oct 30 21:55:32.817626 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.817629    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-image-registry-private-configuration\") pod \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") "
Oct 30 21:55:32.817851 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.817663    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-bound-sa-token\") pod \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") "
Oct 30 21:55:32.817851 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.817692    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-kube-api-access-zb6hh\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-kube-api-access-zb6hh\") pod \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") "
Oct 30 21:55:32.817851 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.817743    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-installation-pull-secrets\") pod \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") "
Oct 30 21:55:32.817851 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.817773    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-trusted-ca\") pod \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") "
Oct 30 21:55:32.817851 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.817792    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls\") pod \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") "
Oct 30 21:55:32.817851 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.817820    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-certificates\") pod \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\" (UID: \"cf5df1af-34a5-4168-9f99-b1e8319f6f2b\") "
Oct 30 21:55:32.818354 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.818287    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-trusted-ca" pod "cf5df1af-34a5-4168-9f99-b1e8319f6f2b" (UID: "cf5df1af-34a5-4168-9f99-b1e8319f6f2b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:55:32.818354 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.818328    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-certificates" pod "cf5df1af-34a5-4168-9f99-b1e8319f6f2b" (UID: "cf5df1af-34a5-4168-9f99-b1e8319f6f2b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:55:32.820394 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.820345    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-bound-sa-token" pod "cf5df1af-34a5-4168-9f99-b1e8319f6f2b" (UID: "cf5df1af-34a5-4168-9f99-b1e8319f6f2b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:55:32.820623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.820427    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-image-registry-private-configuration" pod "cf5df1af-34a5-4168-9f99-b1e8319f6f2b" (UID: "cf5df1af-34a5-4168-9f99-b1e8319f6f2b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:55:32.820623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.820485    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-kube-api-access-zb6hh" pod "cf5df1af-34a5-4168-9f99-b1e8319f6f2b" (UID: "cf5df1af-34a5-4168-9f99-b1e8319f6f2b"). InnerVolumeSpecName "kube-api-access-zb6hh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:55:32.820623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.820508    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-installation-pull-secrets" pod "cf5df1af-34a5-4168-9f99-b1e8319f6f2b" (UID: "cf5df1af-34a5-4168-9f99-b1e8319f6f2b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:55:32.820623 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.820563    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls" pod "cf5df1af-34a5-4168-9f99-b1e8319f6f2b" (UID: "cf5df1af-34a5-4168-9f99-b1e8319f6f2b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:55:32.824412 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.824385    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-ca-trust-extracted" pod "cf5df1af-34a5-4168-9f99-b1e8319f6f2b" (UID: "cf5df1af-34a5-4168-9f99-b1e8319f6f2b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:32.918496 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.918472    5258 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-bound-sa-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:32.918496 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.918494    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb6hh\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-kube-api-access-zb6hh\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:32.918646 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.918505    5258 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-installation-pull-secrets\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:32.918646 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.918514    5258 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-trusted-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:32.918646 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.918523    5258 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:32.918646 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.918531    5258 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-registry-certificates\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:32.918646 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.918539    5258 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-ca-trust-extracted\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:32.918646 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.918549    5258 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf5df1af-34a5-4168-9f99-b1e8319f6f2b-image-registry-private-configuration\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:32.980539 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:32.980470    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:33.655887 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:33.655803    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6" event={"ID":"cf5df1af-34a5-4168-9f99-b1e8319f6f2b","Type":"ContainerDied","Data":"a93bbca4cfb31acc69093e78798481b6526b4be894c096571d3697e1890413ff"}
Oct 30 21:55:33.655887 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:33.655823    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9c975d75-kkjl6"
Oct 30 21:55:33.655887 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:33.655862    5258 scope.go:122] "RemoveContainer" containerID="a21ff6c1e7fde6e29bb6eb0982554eb956dd0f5166832724cbaa1c2c5cdf42cc"
Oct 30 21:55:33.870399 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:33.870368    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b9c975d75-kkjl6"]
Oct 30 21:55:33.919732 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:33.919658    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b9c975d75-kkjl6"]
Oct 30 21:55:35.377663 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:35.377632    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf5df1af-34a5-4168-9f99-b1e8319f6f2b" path="/var/lib/kubelet/pods/cf5df1af-34a5-4168-9f99-b1e8319f6f2b/volumes"
Oct 30 21:55:43.158642 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:55:43.158603    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 21:55:47.707347 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:47.707314    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:47.969336 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:47.969250    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:55.460030 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:55.459989    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:55.751376 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:55.751301    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:58.468504 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:58.468471    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:58.694888 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:55:58.694852    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:05.586977 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:56:05.586941    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:05.888698 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:56:05.888624    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:06.122737 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:56:06.122703    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:13.159405 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:56:13.159368    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 21:56:15.558395 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:56:15.558352    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:43.160113 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:56:43.160034    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 21:57:13.158988 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:57:13.158951    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 21:57:13.332757 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:57:13.332722    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:13.603702 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:57:13.603672    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:14.490930 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:57:14.490891    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:14.771198 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:57:14.771110    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:15.011785 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:57:15.011748    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:15.881110 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:57:15.881077    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:26.067488 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:57:26.067451    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:26.337424 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:57:26.337340    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:32.704018 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:57:32.703983    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:32.969514 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:57:32.969417    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:43.158919 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:57:43.158881    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 21:58:13.159514 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:58:13.159467    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 21:58:16.232522 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:58:16.232485    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:16.506037 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:58:16.505951    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:43.159345 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:58:43.159305    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 21:58:52.943786 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:58:52.943754    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:53.179607 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:58:53.179563    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:01.483642 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:01.483608    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:03.530081 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:03.530041    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:08.542344 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:08.542296    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:13.159300 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:59:13.159262    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 21:59:16.581806 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:16.581767    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:43.159626 ip-10-0-137-32 kubenswrapper[5258]: E1030 21:59:43.159528    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 21:59:45.381860 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:45.381830    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 21:59:45.383007 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:45.382987    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 21:59:49.594034 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:49.593987    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:49.833112 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:49.833076    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:50.992923 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:50.992892    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"]
Oct 30 21:59:50.993290 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:50.993195    5258 cpu_manager.go:414] "containerMap: removing container" podUID="cf5df1af-34a5-4168-9f99-b1e8319f6f2b" containerName="registry"
Oct 30 21:59:50.993290 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:50.993208    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf5df1af-34a5-4168-9f99-b1e8319f6f2b" containerName="registry"
Oct 30 21:59:50.993290 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:50.993273    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf5df1af-34a5-4168-9f99-b1e8319f6f2b" containerName="registry"
Oct 30 21:59:50.996370 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:50.996354    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"
Oct 30 21:59:51.050324 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.050300    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 21:59:51.086535 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.086509    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 21:59:51.096819 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.096790    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/005b3f30-82f6-418c-9b2b-56430df557ba-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9\" (UID: \"005b3f30-82f6-418c-9b2b-56430df557ba\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"
Oct 30 21:59:51.096917 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.096847    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/005b3f30-82f6-418c-9b2b-56430df557ba-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9\" (UID: \"005b3f30-82f6-418c-9b2b-56430df557ba\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"
Oct 30 21:59:51.096959 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.096940    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzsqs\" (UniqueName: \"kubernetes.io/projected/005b3f30-82f6-418c-9b2b-56430df557ba-kube-api-access-gzsqs\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9\" (UID: \"005b3f30-82f6-418c-9b2b-56430df557ba\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"
Oct 30 21:59:51.097921 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.097904    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-nl4h9\""
Oct 30 21:59:51.098754 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.098743    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"]
Oct 30 21:59:51.197495 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.197467    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/005b3f30-82f6-418c-9b2b-56430df557ba-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9\" (UID: \"005b3f30-82f6-418c-9b2b-56430df557ba\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"
Oct 30 21:59:51.197674 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.197510    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzsqs\" (UniqueName: \"kubernetes.io/projected/005b3f30-82f6-418c-9b2b-56430df557ba-kube-api-access-gzsqs\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9\" (UID: \"005b3f30-82f6-418c-9b2b-56430df557ba\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"
Oct 30 21:59:51.197674 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.197536    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/005b3f30-82f6-418c-9b2b-56430df557ba-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9\" (UID: \"005b3f30-82f6-418c-9b2b-56430df557ba\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"
Oct 30 21:59:51.197877 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.197857    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/005b3f30-82f6-418c-9b2b-56430df557ba-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9\" (UID: \"005b3f30-82f6-418c-9b2b-56430df557ba\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"
Oct 30 21:59:51.197932 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.197888    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/005b3f30-82f6-418c-9b2b-56430df557ba-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9\" (UID: \"005b3f30-82f6-418c-9b2b-56430df557ba\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"
Oct 30 21:59:51.222199 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.222175    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:51.266305 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.266260    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzsqs\" (UniqueName: \"kubernetes.io/projected/005b3f30-82f6-418c-9b2b-56430df557ba-kube-api-access-gzsqs\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9\" (UID: \"005b3f30-82f6-418c-9b2b-56430df557ba\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"
Oct 30 21:59:51.312311 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.312290    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"
Oct 30 21:59:51.537814 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.537733    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:51.683199 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.683171    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"]
Oct 30 21:59:51.686701 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:59:51.686671    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005b3f30_82f6_418c_9b2b_56430df557ba.slice/crio-407e13f2ae837f2e4c73db23f427dcc1d998f55456e4266025e491886d2963b3 WatchSource:0}: Error finding container 407e13f2ae837f2e4c73db23f427dcc1d998f55456e4266025e491886d2963b3: Status 404 returned error can't find the container with id 407e13f2ae837f2e4c73db23f427dcc1d998f55456e4266025e491886d2963b3
Oct 30 21:59:51.688511 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:51.688494    5258 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:59:52.541585 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:52.541553    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9" event={"ID":"005b3f30-82f6-418c-9b2b-56430df557ba","Type":"ContainerStarted","Data":"407e13f2ae837f2e4c73db23f427dcc1d998f55456e4266025e491886d2963b3"}
Oct 30 21:59:52.909437 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:52.909401    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:53.100679 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.100648    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"]
Oct 30 21:59:53.103879 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.103863    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"
Oct 30 21:59:53.112166 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.112142    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk72j\" (UniqueName: \"kubernetes.io/projected/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-kube-api-access-sk72j\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827\" (UID: \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"
Oct 30 21:59:53.112288 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.112186    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827\" (UID: \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"
Oct 30 21:59:53.112382 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.112359    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827\" (UID: \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"
Oct 30 21:59:53.205902 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.205829    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-zvgjg\""
Oct 30 21:59:53.206851 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.206818    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"]
Oct 30 21:59:53.213361 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.213340    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk72j\" (UniqueName: \"kubernetes.io/projected/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-kube-api-access-sk72j\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827\" (UID: \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"
Oct 30 21:59:53.213417 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.213376    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827\" (UID: \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"
Oct 30 21:59:53.213452 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.213418    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827\" (UID: \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"
Oct 30 21:59:53.213745 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.213730    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827\" (UID: \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"
Oct 30 21:59:53.213790 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.213766    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827\" (UID: \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"
Oct 30 21:59:53.275851 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.275827    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk72j\" (UniqueName: \"kubernetes.io/projected/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-kube-api-access-sk72j\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827\" (UID: \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"
Oct 30 21:59:53.419755 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.419727    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"
Oct 30 21:59:53.798173 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:53.798096    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"]
Oct 30 21:59:53.801795 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:59:53.801765    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e15c05_9c9a_4318_96c7_ffffe4ff31bf.slice/crio-3cce6072bba13b4c8e352b886be532b2150924f0f722f78179b6b1093eb01a09 WatchSource:0}: Error finding container 3cce6072bba13b4c8e352b886be532b2150924f0f722f78179b6b1093eb01a09: Status 404 returned error can't find the container with id 3cce6072bba13b4c8e352b886be532b2150924f0f722f78179b6b1093eb01a09
Oct 30 21:59:54.549493 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:54.549459    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827" event={"ID":"95e15c05-9c9a-4318-96c7-ffffe4ff31bf","Type":"ContainerStarted","Data":"3cce6072bba13b4c8e352b886be532b2150924f0f722f78179b6b1093eb01a09"}
Oct 30 21:59:55.384765 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.384732    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"]
Oct 30 21:59:55.388180 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.388160    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"
Oct 30 21:59:55.431094 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.431070    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr\" (UID: \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"
Oct 30 21:59:55.431215 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.431161    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr\" (UID: \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"
Oct 30 21:59:55.431215 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.431192    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmjpm\" (UniqueName: \"kubernetes.io/projected/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-kube-api-access-lmjpm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr\" (UID: \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"
Oct 30 21:59:55.493449 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.493418    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-phhz2\""
Oct 30 21:59:55.494871 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.494848    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"]
Oct 30 21:59:55.495689 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.495667    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"]
Oct 30 21:59:55.499176 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.499155    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"
Oct 30 21:59:55.531612 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.531566    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws\" (UID: \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"
Oct 30 21:59:55.531721 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.531670    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr\" (UID: \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"
Oct 30 21:59:55.531721 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.531712    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws\" (UID: \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"
Oct 30 21:59:55.531814 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.531741    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcz7r\" (UniqueName: \"kubernetes.io/projected/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-kube-api-access-tcz7r\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws\" (UID: \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"
Oct 30 21:59:55.531814 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.531776    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr\" (UID: \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"
Oct 30 21:59:55.531814 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.531806    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmjpm\" (UniqueName: \"kubernetes.io/projected/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-kube-api-access-lmjpm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr\" (UID: \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"
Oct 30 21:59:55.532100 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.532082    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr\" (UID: \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"
Oct 30 21:59:55.532155 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.532090    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr\" (UID: \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"
Oct 30 21:59:55.540479 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.540458    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"]
Oct 30 21:59:55.553257 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.553241    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-kmwrc\""
Oct 30 21:59:55.589256 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.589225    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"]
Oct 30 21:59:55.592872 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.592853    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"
Oct 30 21:59:55.594016 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.593997    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmjpm\" (UniqueName: \"kubernetes.io/projected/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-kube-api-access-lmjpm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr\" (UID: \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"
Oct 30 21:59:55.632495 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.632470    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18765b3b-731c-4fee-90a2-37f73a020849-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4\" (UID: \"18765b3b-731c-4fee-90a2-37f73a020849\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"
Oct 30 21:59:55.632617 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.632507    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xllvn\" (UniqueName: \"kubernetes.io/projected/18765b3b-731c-4fee-90a2-37f73a020849-kube-api-access-xllvn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4\" (UID: \"18765b3b-731c-4fee-90a2-37f73a020849\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"
Oct 30 21:59:55.632694 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.632651    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws\" (UID: \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"
Oct 30 21:59:55.632754 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.632693    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18765b3b-731c-4fee-90a2-37f73a020849-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4\" (UID: \"18765b3b-731c-4fee-90a2-37f73a020849\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"
Oct 30 21:59:55.632754 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.632729    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws\" (UID: \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"
Oct 30 21:59:55.632857 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.632762    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcz7r\" (UniqueName: \"kubernetes.io/projected/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-kube-api-access-tcz7r\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws\" (UID: \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"
Oct 30 21:59:55.633036 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.633018    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws\" (UID: \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"
Oct 30 21:59:55.633101 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.633055    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws\" (UID: \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"
Oct 30 21:59:55.639527 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.639483    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"]
Oct 30 21:59:55.653674 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.653656    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-vdmdk\""
Oct 30 21:59:55.672935 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.672914    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"]
Oct 30 21:59:55.676395 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.676378    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"
Oct 30 21:59:55.694985 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.694962    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcz7r\" (UniqueName: \"kubernetes.io/projected/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-kube-api-access-tcz7r\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws\" (UID: \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"
Oct 30 21:59:55.705744 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.705727    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"
Oct 30 21:59:55.733229 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.733203    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18765b3b-731c-4fee-90a2-37f73a020849-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4\" (UID: \"18765b3b-731c-4fee-90a2-37f73a020849\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"
Oct 30 21:59:55.733356 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.733255    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xllvn\" (UniqueName: \"kubernetes.io/projected/18765b3b-731c-4fee-90a2-37f73a020849-kube-api-access-xllvn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4\" (UID: \"18765b3b-731c-4fee-90a2-37f73a020849\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"
Oct 30 21:59:55.733356 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.733284    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw\" (UID: \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"
Oct 30 21:59:55.733356 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.733348    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18765b3b-731c-4fee-90a2-37f73a020849-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4\" (UID: \"18765b3b-731c-4fee-90a2-37f73a020849\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"
Oct 30 21:59:55.733514 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.733382    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw\" (UID: \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"
Oct 30 21:59:55.733620 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.733556    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s92m6\" (UniqueName: \"kubernetes.io/projected/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-kube-api-access-s92m6\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw\" (UID: \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"
Oct 30 21:59:55.733739 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.733671    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18765b3b-731c-4fee-90a2-37f73a020849-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4\" (UID: \"18765b3b-731c-4fee-90a2-37f73a020849\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"
Oct 30 21:59:55.733739 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.733702    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18765b3b-731c-4fee-90a2-37f73a020849-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4\" (UID: \"18765b3b-731c-4fee-90a2-37f73a020849\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"
Oct 30 21:59:55.736755 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.736730    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"]
Oct 30 21:59:55.754517 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.754493    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-7ffxt\""
Oct 30 21:59:55.797125 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.797095    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xllvn\" (UniqueName: \"kubernetes.io/projected/18765b3b-731c-4fee-90a2-37f73a020849-kube-api-access-xllvn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4\" (UID: \"18765b3b-731c-4fee-90a2-37f73a020849\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"
Oct 30 21:59:55.817030 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.817005    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"
Oct 30 21:59:55.834383 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.834361    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw\" (UID: \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"
Oct 30 21:59:55.834467 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.834410    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw\" (UID: \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"
Oct 30 21:59:55.834467 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.834447    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s92m6\" (UniqueName: \"kubernetes.io/projected/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-kube-api-access-s92m6\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw\" (UID: \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"
Oct 30 21:59:55.834781 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.834750    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw\" (UID: \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"
Oct 30 21:59:55.834912 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.834811    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw\" (UID: \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"
Oct 30 21:59:55.897071 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.896994    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s92m6\" (UniqueName: \"kubernetes.io/projected/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-kube-api-access-s92m6\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw\" (UID: \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"
Oct 30 21:59:55.915100 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.915075    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"
Oct 30 21:59:55.991668 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:55.991641    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"
Oct 30 21:59:56.088831 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.088801    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"]
Oct 30 21:59:56.092167 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:59:56.092135    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a0a167_a6bb_4c50_a2b0_eaf7cb5a1632.slice/crio-473b8d48ea601f6921a3424046b4baf5c9efed8a37856fc0363b7f0c0a572e18 WatchSource:0}: Error finding container 473b8d48ea601f6921a3424046b4baf5c9efed8a37856fc0363b7f0c0a572e18: Status 404 returned error can't find the container with id 473b8d48ea601f6921a3424046b4baf5c9efed8a37856fc0363b7f0c0a572e18
Oct 30 21:59:56.194938 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.194856    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"]
Oct 30 21:59:56.198554 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:59:56.198526    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef76aa9_a05b_4089_8294_48d7ebb2b2f5.slice/crio-e8f8b6dbfa0372dbf27c13f03277ff8112baccdbcd72cf5696b18698bbc5d0cd WatchSource:0}: Error finding container e8f8b6dbfa0372dbf27c13f03277ff8112baccdbcd72cf5696b18698bbc5d0cd: Status 404 returned error can't find the container with id e8f8b6dbfa0372dbf27c13f03277ff8112baccdbcd72cf5696b18698bbc5d0cd
Oct 30 21:59:56.290947 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.290917    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"]
Oct 30 21:59:56.294670 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:59:56.294645    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18765b3b_731c_4fee_90a2_37f73a020849.slice/crio-d3ce5c4dd51b8263b901c4aea9046357f748605609cdf962a9f722b14a4c7fd5 WatchSource:0}: Error finding container d3ce5c4dd51b8263b901c4aea9046357f748605609cdf962a9f722b14a4c7fd5: Status 404 returned error can't find the container with id d3ce5c4dd51b8263b901c4aea9046357f748605609cdf962a9f722b14a4c7fd5
Oct 30 21:59:56.373180 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.373156    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"]
Oct 30 21:59:56.376582 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:59:56.376551    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd2c788_e997_4e58_89fb_d5a3f474cbf6.slice/crio-59389f2b5db764232e1acb85ef2ab96ab6cbac35b16dc7af961ddc2fa5b864c2 WatchSource:0}: Error finding container 59389f2b5db764232e1acb85ef2ab96ab6cbac35b16dc7af961ddc2fa5b864c2: Status 404 returned error can't find the container with id 59389f2b5db764232e1acb85ef2ab96ab6cbac35b16dc7af961ddc2fa5b864c2
Oct 30 21:59:56.466151 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.466077    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"]
Oct 30 21:59:56.470016 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.469989    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"
Oct 30 21:59:56.523548 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.523528    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-qnd8v\""
Oct 30 21:59:56.530633 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.530605    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"]
Oct 30 21:59:56.539961 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.539940    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzgjp\" (UniqueName: \"kubernetes.io/projected/70affa35-c271-49dc-bc8b-69cdc275e660-kube-api-access-dzgjp\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb\" (UID: \"70affa35-c271-49dc-bc8b-69cdc275e660\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"
Oct 30 21:59:56.540066 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.539992    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70affa35-c271-49dc-bc8b-69cdc275e660-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb\" (UID: \"70affa35-c271-49dc-bc8b-69cdc275e660\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"
Oct 30 21:59:56.540107 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.540083    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70affa35-c271-49dc-bc8b-69cdc275e660-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb\" (UID: \"70affa35-c271-49dc-bc8b-69cdc275e660\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"
Oct 30 21:59:56.562467 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.562434    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4" event={"ID":"18765b3b-731c-4fee-90a2-37f73a020849","Type":"ContainerStarted","Data":"d3ce5c4dd51b8263b901c4aea9046357f748605609cdf962a9f722b14a4c7fd5"}
Oct 30 21:59:56.563544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.563516    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws" event={"ID":"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5","Type":"ContainerStarted","Data":"e8f8b6dbfa0372dbf27c13f03277ff8112baccdbcd72cf5696b18698bbc5d0cd"}
Oct 30 21:59:56.564666 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.564636    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw" event={"ID":"0dd2c788-e997-4e58-89fb-d5a3f474cbf6","Type":"ContainerStarted","Data":"59389f2b5db764232e1acb85ef2ab96ab6cbac35b16dc7af961ddc2fa5b864c2"}
Oct 30 21:59:56.565729 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.565711    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr" event={"ID":"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632","Type":"ContainerStarted","Data":"473b8d48ea601f6921a3424046b4baf5c9efed8a37856fc0363b7f0c0a572e18"}
Oct 30 21:59:56.640830 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.640805    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70affa35-c271-49dc-bc8b-69cdc275e660-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb\" (UID: \"70affa35-c271-49dc-bc8b-69cdc275e660\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"
Oct 30 21:59:56.640934 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.640853    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzgjp\" (UniqueName: \"kubernetes.io/projected/70affa35-c271-49dc-bc8b-69cdc275e660-kube-api-access-dzgjp\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb\" (UID: \"70affa35-c271-49dc-bc8b-69cdc275e660\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"
Oct 30 21:59:56.640934 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.640896    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70affa35-c271-49dc-bc8b-69cdc275e660-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb\" (UID: \"70affa35-c271-49dc-bc8b-69cdc275e660\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"
Oct 30 21:59:56.641148 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.641130    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70affa35-c271-49dc-bc8b-69cdc275e660-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb\" (UID: \"70affa35-c271-49dc-bc8b-69cdc275e660\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"
Oct 30 21:59:56.641228 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.641212    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70affa35-c271-49dc-bc8b-69cdc275e660-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb\" (UID: \"70affa35-c271-49dc-bc8b-69cdc275e660\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"
Oct 30 21:59:56.714834 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.714807    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzgjp\" (UniqueName: \"kubernetes.io/projected/70affa35-c271-49dc-bc8b-69cdc275e660-kube-api-access-dzgjp\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb\" (UID: \"70affa35-c271-49dc-bc8b-69cdc275e660\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"
Oct 30 21:59:56.790643 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.790564    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"
Oct 30 21:59:56.931746 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.931709    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"]
Oct 30 21:59:56.935998 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.935976    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"
Oct 30 21:59:56.996768 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:56.996741    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"]
Oct 30 21:59:57.044579 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.044521    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drkxl\" (UniqueName: \"kubernetes.io/projected/21cebb90-951e-4dbe-aef3-184c858d0767-kube-api-access-drkxl\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x\" (UID: \"21cebb90-951e-4dbe-aef3-184c858d0767\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"
Oct 30 21:59:57.044726 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.044583    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21cebb90-951e-4dbe-aef3-184c858d0767-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x\" (UID: \"21cebb90-951e-4dbe-aef3-184c858d0767\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"
Oct 30 21:59:57.044726 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.044670    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21cebb90-951e-4dbe-aef3-184c858d0767-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x\" (UID: \"21cebb90-951e-4dbe-aef3-184c858d0767\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"
Oct 30 21:59:57.146894 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.145410    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21cebb90-951e-4dbe-aef3-184c858d0767-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x\" (UID: \"21cebb90-951e-4dbe-aef3-184c858d0767\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"
Oct 30 21:59:57.146894 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.145490    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21cebb90-951e-4dbe-aef3-184c858d0767-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x\" (UID: \"21cebb90-951e-4dbe-aef3-184c858d0767\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"
Oct 30 21:59:57.146894 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.145579    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drkxl\" (UniqueName: \"kubernetes.io/projected/21cebb90-951e-4dbe-aef3-184c858d0767-kube-api-access-drkxl\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x\" (UID: \"21cebb90-951e-4dbe-aef3-184c858d0767\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"
Oct 30 21:59:57.146894 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.146504    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21cebb90-951e-4dbe-aef3-184c858d0767-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x\" (UID: \"21cebb90-951e-4dbe-aef3-184c858d0767\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"
Oct 30 21:59:57.146894 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.146826    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21cebb90-951e-4dbe-aef3-184c858d0767-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x\" (UID: \"21cebb90-951e-4dbe-aef3-184c858d0767\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"
Oct 30 21:59:57.182720 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.182687    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"]
Oct 30 21:59:57.192914 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:59:57.192873    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70affa35_c271_49dc_bc8b_69cdc275e660.slice/crio-841e80bf7829c85056f7acf1e387980afa5b1035d5a875290e90ce6ef6bd6b94 WatchSource:0}: Error finding container 841e80bf7829c85056f7acf1e387980afa5b1035d5a875290e90ce6ef6bd6b94: Status 404 returned error can't find the container with id 841e80bf7829c85056f7acf1e387980afa5b1035d5a875290e90ce6ef6bd6b94
Oct 30 21:59:57.211429 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.211399    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drkxl\" (UniqueName: \"kubernetes.io/projected/21cebb90-951e-4dbe-aef3-184c858d0767-kube-api-access-drkxl\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x\" (UID: \"21cebb90-951e-4dbe-aef3-184c858d0767\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"
Oct 30 21:59:57.253743 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.253703    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"
Oct 30 21:59:57.300635 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.300499    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:57.577283 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.577245    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb" event={"ID":"70affa35-c271-49dc-bc8b-69cdc275e660","Type":"ContainerStarted","Data":"841e80bf7829c85056f7acf1e387980afa5b1035d5a875290e90ce6ef6bd6b94"}
Oct 30 21:59:57.676012 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.675970    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"]
Oct 30 21:59:57.680982 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.680171    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.684754 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.684721    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:57.710152 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.709920    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"]
Oct 30 21:59:57.713672 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:59:57.713641    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cebb90_951e_4dbe_aef3_184c858d0767.slice/crio-1c94fb04cfcea91f1b854e6fffa628abd3f9d813745e5a981c28c72dc736cdf5 WatchSource:0}: Error finding container 1c94fb04cfcea91f1b854e6fffa628abd3f9d813745e5a981c28c72dc736cdf5: Status 404 returned error can't find the container with id 1c94fb04cfcea91f1b854e6fffa628abd3f9d813745e5a981c28c72dc736cdf5
Oct 30 21:59:57.738306 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.738281    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 21:59:57.738306 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.738303    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9qrfj\""
Oct 30 21:59:57.751444 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.751413    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcm9v\" (UniqueName: \"kubernetes.io/projected/d804a5f8-76b1-4ac5-bef4-ab73965299f6-kube-api-access-bcm9v\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.751632 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.751472    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.751632 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.751508    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.751632 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.751551    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.751632 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.751572    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.751632 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.751611    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.751899 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.751643    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.751899 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.751670    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.751899 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.751703    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.752315 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.752244    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"]
Oct 30 21:59:57.854118 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.852384    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.854118 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.852434    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.854118 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.852500    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcm9v\" (UniqueName: \"kubernetes.io/projected/d804a5f8-76b1-4ac5-bef4-ab73965299f6-kube-api-access-bcm9v\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.854118 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.852542    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.854118 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.852574    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.854118 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.852630    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.854118 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.852670    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.854118 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.852695    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.854118 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.852742    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.854118 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.853222    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.854118 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.854046    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.854886 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.854312    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.854886 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.854648    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.854886 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.854784    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.857020 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.856981    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.859171 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.859116    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.924406 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.924303    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcm9v\" (UniqueName: \"kubernetes.io/projected/d804a5f8-76b1-4ac5-bef4-ab73965299f6-kube-api-access-bcm9v\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.925032 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.925002    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d804a5f8-76b1-4ac5-bef4-ab73965299f6-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-x6hg4\" (UID: \"d804a5f8-76b1-4ac5-bef4-ab73965299f6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:57.957624 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.957577    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:57.997207 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:57.997123    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 21:59:58.013376 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.011721    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"]
Oct 30 21:59:58.017507 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.017079    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.055396 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.055355    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d035a377-67b0-4288-8b37-329883c8b58d-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.055530 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.055407    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.055530 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.055439    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d035a377-67b0-4288-8b37-329883c8b58d-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.055530 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.055481    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dqc6\" (UniqueName: \"kubernetes.io/projected/d035a377-67b0-4288-8b37-329883c8b58d-kube-api-access-5dqc6\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.055760 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.055733    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.055831 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.055783    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d035a377-67b0-4288-8b37-329883c8b58d-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.055888 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.055868    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.055942 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.055902    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.055998 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.055942    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.071976 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.071945    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-lfljg\""
Oct 30 21:59:58.086958 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.082194    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"]
Oct 30 21:59:58.158544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.156680    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.158544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.156729    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.158544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.156760    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.158544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.156837    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d035a377-67b0-4288-8b37-329883c8b58d-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.158544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.156902    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.158544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.156939    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d035a377-67b0-4288-8b37-329883c8b58d-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.158544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.156970    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dqc6\" (UniqueName: \"kubernetes.io/projected/d035a377-67b0-4288-8b37-329883c8b58d-kube-api-access-5dqc6\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.158544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.157005    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.158544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.157031    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d035a377-67b0-4288-8b37-329883c8b58d-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.158544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.157714    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.158544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.157959    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.158544 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.158189    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.159284 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.159246    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d035a377-67b0-4288-8b37-329883c8b58d-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.159934 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.159842    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.160985 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.160937    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d035a377-67b0-4288-8b37-329883c8b58d-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.162440 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.162416    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d035a377-67b0-4288-8b37-329883c8b58d-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.191602 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.191448    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:58.241009 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.240917    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dqc6\" (UniqueName: \"kubernetes.io/projected/d035a377-67b0-4288-8b37-329883c8b58d-kube-api-access-5dqc6\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.249211 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.249152    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d035a377-67b0-4288-8b37-329883c8b58d-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw\" (UID: \"d035a377-67b0-4288-8b37-329883c8b58d\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.337213 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.337152    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 21:59:58.439810 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.439776    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:58.456227 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.456058    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"]
Oct 30 21:59:58.462013 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:59:58.461969    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd804a5f8_76b1_4ac5_bef4_ab73965299f6.slice/crio-89245621b93d9e2acedd8997672de5747acd8b58981dfb0c36e49dbf00d8bd69 WatchSource:0}: Error finding container 89245621b93d9e2acedd8997672de5747acd8b58981dfb0c36e49dbf00d8bd69: Status 404 returned error can't find the container with id 89245621b93d9e2acedd8997672de5747acd8b58981dfb0c36e49dbf00d8bd69
Oct 30 21:59:58.624372 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.624252    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4" event={"ID":"d804a5f8-76b1-4ac5-bef4-ab73965299f6","Type":"ContainerStarted","Data":"89245621b93d9e2acedd8997672de5747acd8b58981dfb0c36e49dbf00d8bd69"}
Oct 30 21:59:58.630843 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.630747    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x" event={"ID":"21cebb90-951e-4dbe-aef3-184c858d0767","Type":"ContainerStarted","Data":"1c94fb04cfcea91f1b854e6fffa628abd3f9d813745e5a981c28c72dc736cdf5"}
Oct 30 21:59:58.758888 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:58.758799    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"]
Oct 30 21:59:58.767514 ip-10-0-137-32 kubenswrapper[5258]: W1030 21:59:58.767479    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd035a377_67b0_4288_8b37_329883c8b58d.slice/crio-0323a49e7232f03a4e579d42e2024016208fa3fdc6e4ff6ec941ce25343682ec WatchSource:0}: Error finding container 0323a49e7232f03a4e579d42e2024016208fa3fdc6e4ff6ec941ce25343682ec: Status 404 returned error can't find the container with id 0323a49e7232f03a4e579d42e2024016208fa3fdc6e4ff6ec941ce25343682ec
Oct 30 21:59:59.642172 ip-10-0-137-32 kubenswrapper[5258]: I1030 21:59:59.642133    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw" event={"ID":"d035a377-67b0-4288-8b37-329883c8b58d","Type":"ContainerStarted","Data":"0323a49e7232f03a4e579d42e2024016208fa3fdc6e4ff6ec941ce25343682ec"}
Oct 30 22:00:02.281272 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:02.281235    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:08.421244 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:08.421212    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:00:08.421694 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:08.421279    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:00:08.421694 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:08.421312    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:00:08.744094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:08.743945    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw" event={"ID":"d035a377-67b0-4288-8b37-329883c8b58d","Type":"ContainerStarted","Data":"500255a81f3ddb9ec1e2386f2f6b0835ea1a190d1ce852bc8b48524a2aff5ec7"}
Oct 30 22:00:08.852749 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:08.852706    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:00:08.852877 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:08.852793    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:00:08.852877 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:08.852839    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:00:08.958339 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:08.958241    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw" podStartSLOduration=2.308012522 podStartE2EDuration="11.958223846s" totalImagesPullingTime="9.650211324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:08.947223486 +0000 UTC m=+323.678080628" watchObservedRunningTime="2026-10-30 22:00:08.958223846 +0000 UTC m=+323.689080989"
Oct 30 22:00:09.340090 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:09.338250    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 22:00:09.344690 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:09.344464    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 22:00:09.764735 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:09.764558    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4" event={"ID":"d804a5f8-76b1-4ac5-bef4-ab73965299f6","Type":"ContainerStarted","Data":"c1829ec3188900fc92158f5a78c49d224dd88fa91fd698c365c49b8fea2cb886"}
Oct 30 22:00:09.765414 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:09.765337    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 22:00:09.766838 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:09.766766    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw"
Oct 30 22:00:09.894353 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:09.893042    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4" podStartSLOduration=2.515042492 podStartE2EDuration="12.893019257s" totalImagesPullingTime="10.377976765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:09.891639063 +0000 UTC m=+324.622496208" watchObservedRunningTime="2026-10-30 22:00:09.893019257 +0000 UTC m=+324.623876400"
Oct 30 22:00:09.997890 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:09.997578    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 22:00:10.004263 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:10.004206    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 22:00:10.771075 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:10.771015    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 22:00:10.772966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:10.772725    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 22:00:12.803061 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:12.802695    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827" event={"ID":"95e15c05-9c9a-4318-96c7-ffffe4ff31bf","Type":"ContainerStarted","Data":"a034b0b76ecb3b03e8ef3dda35b26c496fa840163d254401b4271d3c97b340c7"}
Oct 30 22:00:13.185740 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:00:13.185675    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:00:13.809439 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:13.809406    5258 generic.go:356] "Generic (PLEG): container finished" podID="95e15c05-9c9a-4318-96c7-ffffe4ff31bf" containerID="a034b0b76ecb3b03e8ef3dda35b26c496fa840163d254401b4271d3c97b340c7" exitCode=0
Oct 30 22:00:13.810179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:13.810146    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827" event={"ID":"95e15c05-9c9a-4318-96c7-ffffe4ff31bf","Type":"ContainerDied","Data":"a034b0b76ecb3b03e8ef3dda35b26c496fa840163d254401b4271d3c97b340c7"}
Oct 30 22:00:13.812391 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:13.812293    5258 generic.go:356] "Generic (PLEG): container finished" podID="18765b3b-731c-4fee-90a2-37f73a020849" containerID="ab5daa6a87b771e3dbb44cd0c460f813fc1ec24d19e533ef03c0e635e45afcd3" exitCode=0
Oct 30 22:00:13.812678 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:13.812557    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4" event={"ID":"18765b3b-731c-4fee-90a2-37f73a020849","Type":"ContainerDied","Data":"ab5daa6a87b771e3dbb44cd0c460f813fc1ec24d19e533ef03c0e635e45afcd3"}
Oct 30 22:00:13.814904 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:13.814877    5258 generic.go:356] "Generic (PLEG): container finished" podID="005b3f30-82f6-418c-9b2b-56430df557ba" containerID="ecfdf9b9e17db0f5623b78314c9c046db530ed0d95e7e7bdd8e2f72e5d43d96c" exitCode=0
Oct 30 22:00:13.815010 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:13.814960    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9" event={"ID":"005b3f30-82f6-418c-9b2b-56430df557ba","Type":"ContainerDied","Data":"ecfdf9b9e17db0f5623b78314c9c046db530ed0d95e7e7bdd8e2f72e5d43d96c"}
Oct 30 22:00:13.817661 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:13.817578    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr" event={"ID":"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632","Type":"ContainerStarted","Data":"a3fc714314f166a6cddba2ca58e5d39fdb9665ef8dadd82198ce4ed434b314c2"}
Oct 30 22:00:14.823348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:14.823316    5258 generic.go:356] "Generic (PLEG): container finished" podID="0dd2c788-e997-4e58-89fb-d5a3f474cbf6" containerID="4f261ee15cea39cbcb3878254c501c450a940414869bbb886480c64f387ea7d7" exitCode=0
Oct 30 22:00:14.823774 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:14.823405    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw" event={"ID":"0dd2c788-e997-4e58-89fb-d5a3f474cbf6","Type":"ContainerDied","Data":"4f261ee15cea39cbcb3878254c501c450a940414869bbb886480c64f387ea7d7"}
Oct 30 22:00:14.825133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:14.825107    5258 generic.go:356] "Generic (PLEG): container finished" podID="52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632" containerID="a3fc714314f166a6cddba2ca58e5d39fdb9665ef8dadd82198ce4ed434b314c2" exitCode=0
Oct 30 22:00:14.825257 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:14.825180    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr" event={"ID":"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632","Type":"ContainerDied","Data":"a3fc714314f166a6cddba2ca58e5d39fdb9665ef8dadd82198ce4ed434b314c2"}
Oct 30 22:00:14.826835 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:14.826815    5258 generic.go:356] "Generic (PLEG): container finished" podID="70affa35-c271-49dc-bc8b-69cdc275e660" containerID="58564facc99f1eaf12669fab9fd8d189874c48f9825b275d974e24603d129993" exitCode=0
Oct 30 22:00:14.826933 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:14.826890    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb" event={"ID":"70affa35-c271-49dc-bc8b-69cdc275e660","Type":"ContainerDied","Data":"58564facc99f1eaf12669fab9fd8d189874c48f9825b275d974e24603d129993"}
Oct 30 22:00:15.833543 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:15.833508    5258 generic.go:356] "Generic (PLEG): container finished" podID="21cebb90-951e-4dbe-aef3-184c858d0767" containerID="a46f93a3895cdb1413dfb697454517ea3405f2c2bedb2e8e7a8d94725cc8675a" exitCode=0
Oct 30 22:00:15.834010 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:15.833605    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x" event={"ID":"21cebb90-951e-4dbe-aef3-184c858d0767","Type":"ContainerDied","Data":"a46f93a3895cdb1413dfb697454517ea3405f2c2bedb2e8e7a8d94725cc8675a"}
Oct 30 22:00:15.836906 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:15.836885    5258 generic.go:356] "Generic (PLEG): container finished" podID="18765b3b-731c-4fee-90a2-37f73a020849" containerID="3d286235ba8fd1e069af80179fd3cfb20f704e3ca04e24647cdee10ca9a39fb8" exitCode=0
Oct 30 22:00:15.837014 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:15.836913    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4" event={"ID":"18765b3b-731c-4fee-90a2-37f73a020849","Type":"ContainerDied","Data":"3d286235ba8fd1e069af80179fd3cfb20f704e3ca04e24647cdee10ca9a39fb8"}
Oct 30 22:00:15.838582 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:15.838560    5258 generic.go:356] "Generic (PLEG): container finished" podID="6ef76aa9-a05b-4089-8294-48d7ebb2b2f5" containerID="aa5bc3917125d17469ba17276a2e696a1b784154b48324d67b407b876d438c58" exitCode=0
Oct 30 22:00:15.838856 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:15.838712    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws" event={"ID":"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5","Type":"ContainerDied","Data":"aa5bc3917125d17469ba17276a2e696a1b784154b48324d67b407b876d438c58"}
Oct 30 22:00:15.840945 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:15.840923    5258 generic.go:356] "Generic (PLEG): container finished" podID="005b3f30-82f6-418c-9b2b-56430df557ba" containerID="51d1d2c2a4400c5614f3a4d179dd659433b3c3eb0317242690e05476682a44e4" exitCode=0
Oct 30 22:00:15.841056 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:15.840989    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9" event={"ID":"005b3f30-82f6-418c-9b2b-56430df557ba","Type":"ContainerDied","Data":"51d1d2c2a4400c5614f3a4d179dd659433b3c3eb0317242690e05476682a44e4"}
Oct 30 22:00:16.848976 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:16.848903    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr" event={"ID":"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632","Type":"ContainerDied","Data":"bace278c576fac4cce4bc77bfae2e0375b1f666ff90159c55bb3021699f29357"}
Oct 30 22:00:16.849463 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:16.848679    5258 generic.go:356] "Generic (PLEG): container finished" podID="52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632" containerID="bace278c576fac4cce4bc77bfae2e0375b1f666ff90159c55bb3021699f29357" exitCode=0
Oct 30 22:00:16.852797 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:16.852772    5258 generic.go:356] "Generic (PLEG): container finished" podID="21cebb90-951e-4dbe-aef3-184c858d0767" containerID="c1fb7ce34d4987ef0379031b325199ae154865465676d0b8bc8fa18a84869d9e" exitCode=0
Oct 30 22:00:16.852924 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:16.852880    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x" event={"ID":"21cebb90-951e-4dbe-aef3-184c858d0767","Type":"ContainerDied","Data":"c1fb7ce34d4987ef0379031b325199ae154865465676d0b8bc8fa18a84869d9e"}
Oct 30 22:00:16.961415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:16.961377    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:17.863226 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:17.862075    5258 generic.go:356] "Generic (PLEG): container finished" podID="0dd2c788-e997-4e58-89fb-d5a3f474cbf6" containerID="1dbd9445ce1664dd2c14f82b94a9585fa2fab3737c6fb9452325c582640b886d" exitCode=0
Oct 30 22:00:17.863226 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:17.862212    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw" event={"ID":"0dd2c788-e997-4e58-89fb-d5a3f474cbf6","Type":"ContainerDied","Data":"1dbd9445ce1664dd2c14f82b94a9585fa2fab3737c6fb9452325c582640b886d"}
Oct 30 22:00:17.867666 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:17.867466    5258 generic.go:356] "Generic (PLEG): container finished" podID="95e15c05-9c9a-4318-96c7-ffffe4ff31bf" containerID="e0a30d8a071864e5bdce5fb3213bc06fa165c566497d9b880e0f19591ab44323" exitCode=0
Oct 30 22:00:17.867666 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:17.867559    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827" event={"ID":"95e15c05-9c9a-4318-96c7-ffffe4ff31bf","Type":"ContainerDied","Data":"e0a30d8a071864e5bdce5fb3213bc06fa165c566497d9b880e0f19591ab44323"}
Oct 30 22:00:17.872900 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:17.872873    5258 generic.go:356] "Generic (PLEG): container finished" podID="6ef76aa9-a05b-4089-8294-48d7ebb2b2f5" containerID="8523d7133db244a1cbf0620c31cf11ccf4e0db9e67ee28d45d575f4f19d02411" exitCode=0
Oct 30 22:00:17.872984 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:17.872954    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws" event={"ID":"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5","Type":"ContainerDied","Data":"8523d7133db244a1cbf0620c31cf11ccf4e0db9e67ee28d45d575f4f19d02411"}
Oct 30 22:00:19.215356 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:19.215315    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:19.736504 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:19.736376    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:22.033136 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:22.033016    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:22.541180 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:22.541147    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:22.919079 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:22.918829    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb" event={"ID":"70affa35-c271-49dc-bc8b-69cdc275e660","Type":"ContainerStarted","Data":"84f2364021f5d8510cb353095a957a230f248c6b4d5ed1bffcaa52af8e6a0ac2"}
Oct 30 22:00:23.559250 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:23.559189    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:23.933200 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:23.932114    5258 generic.go:356] "Generic (PLEG): container finished" podID="70affa35-c271-49dc-bc8b-69cdc275e660" containerID="84f2364021f5d8510cb353095a957a230f248c6b4d5ed1bffcaa52af8e6a0ac2" exitCode=0
Oct 30 22:00:23.933200 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:23.932257    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb" event={"ID":"70affa35-c271-49dc-bc8b-69cdc275e660","Type":"ContainerDied","Data":"84f2364021f5d8510cb353095a957a230f248c6b4d5ed1bffcaa52af8e6a0ac2"}
Oct 30 22:00:32.033356 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:32.032782    5258 generic.go:356] "Generic (PLEG): container finished" podID="005b3f30-82f6-418c-9b2b-56430df557ba" containerID="e08aabb864cd74b604e9ea766771251d6c8dc7a97a1cb3482d45ff2dba106616" exitCode=0
Oct 30 22:00:32.033356 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:32.032921    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9" event={"ID":"005b3f30-82f6-418c-9b2b-56430df557ba","Type":"ContainerDied","Data":"e08aabb864cd74b604e9ea766771251d6c8dc7a97a1cb3482d45ff2dba106616"}
Oct 30 22:00:33.041898 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:33.041859    5258 generic.go:356] "Generic (PLEG): container finished" podID="18765b3b-731c-4fee-90a2-37f73a020849" containerID="e7edb510a017111f71b203e7cc124f40c3379fe4ac17977b4cf6aa1d90410772" exitCode=0
Oct 30 22:00:33.042308 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:33.042030    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4" event={"ID":"18765b3b-731c-4fee-90a2-37f73a020849","Type":"ContainerDied","Data":"e7edb510a017111f71b203e7cc124f40c3379fe4ac17977b4cf6aa1d90410772"}
Oct 30 22:00:33.047693 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:33.047662    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr" event={"ID":"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632","Type":"ContainerStarted","Data":"010a44fef4d29b8d3825eaf9ee8a716f49993b0879283b5d099943f1feba89c4"}
Oct 30 22:00:33.229302 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:33.229270    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"
Oct 30 22:00:33.279196 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:33.279163    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/005b3f30-82f6-418c-9b2b-56430df557ba-bundle\" (UniqueName: \"kubernetes.io/empty-dir/005b3f30-82f6-418c-9b2b-56430df557ba-bundle\") pod \"005b3f30-82f6-418c-9b2b-56430df557ba\" (UID: \"005b3f30-82f6-418c-9b2b-56430df557ba\") "
Oct 30 22:00:33.279374 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:33.279216    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/005b3f30-82f6-418c-9b2b-56430df557ba-kube-api-access-gzsqs\" (UniqueName: \"kubernetes.io/projected/005b3f30-82f6-418c-9b2b-56430df557ba-kube-api-access-gzsqs\") pod \"005b3f30-82f6-418c-9b2b-56430df557ba\" (UID: \"005b3f30-82f6-418c-9b2b-56430df557ba\") "
Oct 30 22:00:33.279374 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:33.279258    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/005b3f30-82f6-418c-9b2b-56430df557ba-util\" (UniqueName: \"kubernetes.io/empty-dir/005b3f30-82f6-418c-9b2b-56430df557ba-util\") pod \"005b3f30-82f6-418c-9b2b-56430df557ba\" (UID: \"005b3f30-82f6-418c-9b2b-56430df557ba\") "
Oct 30 22:00:33.279973 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:33.279911    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/005b3f30-82f6-418c-9b2b-56430df557ba-bundle" pod "005b3f30-82f6-418c-9b2b-56430df557ba" (UID: "005b3f30-82f6-418c-9b2b-56430df557ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:33.283315 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:33.283287    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/005b3f30-82f6-418c-9b2b-56430df557ba-kube-api-access-gzsqs" pod "005b3f30-82f6-418c-9b2b-56430df557ba" (UID: "005b3f30-82f6-418c-9b2b-56430df557ba"). InnerVolumeSpecName "kube-api-access-gzsqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:33.285295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:33.285268    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/005b3f30-82f6-418c-9b2b-56430df557ba-util" pod "005b3f30-82f6-418c-9b2b-56430df557ba" (UID: "005b3f30-82f6-418c-9b2b-56430df557ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:33.292978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:33.292925    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr" podStartSLOduration=3.279449043 podStartE2EDuration="38.292906275s" totalImagesPullingTime="35.013457232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:59:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:33.290887643 +0000 UTC m=+348.021744788" watchObservedRunningTime="2026-10-30 22:00:33.292906275 +0000 UTC m=+348.023763438"
Oct 30 22:00:33.381221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:33.381144    5258 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/005b3f30-82f6-418c-9b2b-56430df557ba-bundle\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:33.381221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:33.381182    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzsqs\" (UniqueName: \"kubernetes.io/projected/005b3f30-82f6-418c-9b2b-56430df557ba-kube-api-access-gzsqs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:33.381221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:33.381198    5258 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/005b3f30-82f6-418c-9b2b-56430df557ba-util\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:34.054668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.054568    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9" event={"ID":"005b3f30-82f6-418c-9b2b-56430df557ba","Type":"ContainerDied","Data":"407e13f2ae837f2e4c73db23f427dcc1d998f55456e4266025e491886d2963b3"}
Oct 30 22:00:34.054668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.054646    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="407e13f2ae837f2e4c73db23f427dcc1d998f55456e4266025e491886d2963b3"
Oct 30 22:00:34.054668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.054585    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71x5jg9"
Oct 30 22:00:34.057436 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.057408    5258 generic.go:356] "Generic (PLEG): container finished" podID="52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632" containerID="010a44fef4d29b8d3825eaf9ee8a716f49993b0879283b5d099943f1feba89c4" exitCode=0
Oct 30 22:00:34.057576 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.057499    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr" event={"ID":"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632","Type":"ContainerDied","Data":"010a44fef4d29b8d3825eaf9ee8a716f49993b0879283b5d099943f1feba89c4"}
Oct 30 22:00:34.060217 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.060195    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb" event={"ID":"70affa35-c271-49dc-bc8b-69cdc275e660","Type":"ContainerStarted","Data":"088fd1027201953ab239a95a104c6b65db7e3a49a953d01d78e04ef7c85aca0f"}
Oct 30 22:00:34.063925 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.063896    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x" event={"ID":"21cebb90-951e-4dbe-aef3-184c858d0767","Type":"ContainerStarted","Data":"6fe40a9c091927b78f70239d011fe061f98a5b936c1e0b21a9b711895128c71b"}
Oct 30 22:00:34.260951 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.260928    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"
Oct 30 22:00:34.307688 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.307641    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x" podStartSLOduration=3.8892961660000003 podStartE2EDuration="38.307624635s" totalImagesPullingTime="34.418328469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:59:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:34.305695891 +0000 UTC m=+349.036553035" watchObservedRunningTime="2026-10-30 22:00:34.307624635 +0000 UTC m=+349.038481778"
Oct 30 22:00:34.391115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.391085    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18765b3b-731c-4fee-90a2-37f73a020849-bundle\" (UniqueName: \"kubernetes.io/empty-dir/18765b3b-731c-4fee-90a2-37f73a020849-bundle\") pod \"18765b3b-731c-4fee-90a2-37f73a020849\" (UID: \"18765b3b-731c-4fee-90a2-37f73a020849\") "
Oct 30 22:00:34.391280 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.391169    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18765b3b-731c-4fee-90a2-37f73a020849-util\" (UniqueName: \"kubernetes.io/empty-dir/18765b3b-731c-4fee-90a2-37f73a020849-util\") pod \"18765b3b-731c-4fee-90a2-37f73a020849\" (UID: \"18765b3b-731c-4fee-90a2-37f73a020849\") "
Oct 30 22:00:34.391280 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.391226    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18765b3b-731c-4fee-90a2-37f73a020849-kube-api-access-xllvn\" (UniqueName: \"kubernetes.io/projected/18765b3b-731c-4fee-90a2-37f73a020849-kube-api-access-xllvn\") pod \"18765b3b-731c-4fee-90a2-37f73a020849\" (UID: \"18765b3b-731c-4fee-90a2-37f73a020849\") "
Oct 30 22:00:34.391692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.391663    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18765b3b-731c-4fee-90a2-37f73a020849-bundle" pod "18765b3b-731c-4fee-90a2-37f73a020849" (UID: "18765b3b-731c-4fee-90a2-37f73a020849"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:34.393229 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.393209    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18765b3b-731c-4fee-90a2-37f73a020849-kube-api-access-xllvn" pod "18765b3b-731c-4fee-90a2-37f73a020849" (UID: "18765b3b-731c-4fee-90a2-37f73a020849"). InnerVolumeSpecName "kube-api-access-xllvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:34.395715 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.395692    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18765b3b-731c-4fee-90a2-37f73a020849-util" pod "18765b3b-731c-4fee-90a2-37f73a020849" (UID: "18765b3b-731c-4fee-90a2-37f73a020849"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:34.478181 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.478131    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb" podStartSLOduration=3.355776449 podStartE2EDuration="38.478116452s" totalImagesPullingTime="35.122340003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:59:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:34.47784301 +0000 UTC m=+349.208700152" watchObservedRunningTime="2026-10-30 22:00:34.478116452 +0000 UTC m=+349.208973595"
Oct 30 22:00:34.491965 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.491942    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xllvn\" (UniqueName: \"kubernetes.io/projected/18765b3b-731c-4fee-90a2-37f73a020849-kube-api-access-xllvn\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:34.491965 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.491965    5258 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18765b3b-731c-4fee-90a2-37f73a020849-bundle\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:34.492069 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:34.491975    5258 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18765b3b-731c-4fee-90a2-37f73a020849-util\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:35.070440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.070413    5258 generic.go:356] "Generic (PLEG): container finished" podID="21cebb90-951e-4dbe-aef3-184c858d0767" containerID="6fe40a9c091927b78f70239d011fe061f98a5b936c1e0b21a9b711895128c71b" exitCode=0
Oct 30 22:00:35.070827 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.070484    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x" event={"ID":"21cebb90-951e-4dbe-aef3-184c858d0767","Type":"ContainerDied","Data":"6fe40a9c091927b78f70239d011fe061f98a5b936c1e0b21a9b711895128c71b"}
Oct 30 22:00:35.072599 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.072563    5258 generic.go:356] "Generic (PLEG): container finished" podID="95e15c05-9c9a-4318-96c7-ffffe4ff31bf" containerID="68b2a32d9d19509c1374d34b2734303a1fc66b7cc90fc0e5cae0fadb83c7cb6b" exitCode=0
Oct 30 22:00:35.072729 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.072653    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827" event={"ID":"95e15c05-9c9a-4318-96c7-ffffe4ff31bf","Type":"ContainerDied","Data":"68b2a32d9d19509c1374d34b2734303a1fc66b7cc90fc0e5cae0fadb83c7cb6b"}
Oct 30 22:00:35.074430 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.074414    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4"
Oct 30 22:00:35.074512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.074433    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cj2sl4" event={"ID":"18765b3b-731c-4fee-90a2-37f73a020849","Type":"ContainerDied","Data":"d3ce5c4dd51b8263b901c4aea9046357f748605609cdf962a9f722b14a4c7fd5"}
Oct 30 22:00:35.074512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.074465    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3ce5c4dd51b8263b901c4aea9046357f748605609cdf962a9f722b14a4c7fd5"
Oct 30 22:00:35.076519 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.076500    5258 generic.go:356] "Generic (PLEG): container finished" podID="6ef76aa9-a05b-4089-8294-48d7ebb2b2f5" containerID="e308ab8d444b5136969f425ca87f84918214baa72c0c69742666535deebb22ff" exitCode=0
Oct 30 22:00:35.076615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.076532    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws" event={"ID":"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5","Type":"ContainerDied","Data":"e308ab8d444b5136969f425ca87f84918214baa72c0c69742666535deebb22ff"}
Oct 30 22:00:35.078756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.078736    5258 generic.go:356] "Generic (PLEG): container finished" podID="0dd2c788-e997-4e58-89fb-d5a3f474cbf6" containerID="d8833fd40acd5c45fd3285f31c952fdeb72bdf0f754182e96df1b67b8694cd2a" exitCode=0
Oct 30 22:00:35.078847 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.078803    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw" event={"ID":"0dd2c788-e997-4e58-89fb-d5a3f474cbf6","Type":"ContainerDied","Data":"d8833fd40acd5c45fd3285f31c952fdeb72bdf0f754182e96df1b67b8694cd2a"}
Oct 30 22:00:35.080694 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.080675    5258 generic.go:356] "Generic (PLEG): container finished" podID="70affa35-c271-49dc-bc8b-69cdc275e660" containerID="088fd1027201953ab239a95a104c6b65db7e3a49a953d01d78e04ef7c85aca0f" exitCode=0
Oct 30 22:00:35.080786 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.080752    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb" event={"ID":"70affa35-c271-49dc-bc8b-69cdc275e660","Type":"ContainerDied","Data":"088fd1027201953ab239a95a104c6b65db7e3a49a953d01d78e04ef7c85aca0f"}
Oct 30 22:00:35.196157 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.196099    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"
Oct 30 22:00:35.299208 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.299184    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-bundle\" (UniqueName: \"kubernetes.io/empty-dir/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-bundle\") pod \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\" (UID: \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\") "
Oct 30 22:00:35.299336 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.299231    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-kube-api-access-lmjpm\" (UniqueName: \"kubernetes.io/projected/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-kube-api-access-lmjpm\") pod \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\" (UID: \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\") "
Oct 30 22:00:35.299336 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.299273    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-util\" (UniqueName: \"kubernetes.io/empty-dir/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-util\") pod \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\" (UID: \"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632\") "
Oct 30 22:00:35.299891 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.299863    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-bundle" pod "52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632" (UID: "52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:35.301385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.301357    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-kube-api-access-lmjpm" pod "52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632" (UID: "52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632"). InnerVolumeSpecName "kube-api-access-lmjpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:35.304643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.304613    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-util" pod "52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632" (UID: "52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:35.400457 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.400431    5258 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-bundle\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:35.400457 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.400458    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmjpm\" (UniqueName: \"kubernetes.io/projected/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-kube-api-access-lmjpm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:35.400614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:35.400468    5258 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632-util\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.087065 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.087033    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr"
Oct 30 22:00:36.087551 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.087084    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a5s7jr" event={"ID":"52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632","Type":"ContainerDied","Data":"473b8d48ea601f6921a3424046b4baf5c9efed8a37856fc0363b7f0c0a572e18"}
Oct 30 22:00:36.087551 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.087156    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="473b8d48ea601f6921a3424046b4baf5c9efed8a37856fc0363b7f0c0a572e18"
Oct 30 22:00:36.238052 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.238025    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"
Oct 30 22:00:36.264082 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.264053    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"
Oct 30 22:00:36.308581 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.308557    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/70affa35-c271-49dc-bc8b-69cdc275e660-kube-api-access-dzgjp\" (UniqueName: \"kubernetes.io/projected/70affa35-c271-49dc-bc8b-69cdc275e660-kube-api-access-dzgjp\") pod \"70affa35-c271-49dc-bc8b-69cdc275e660\" (UID: \"70affa35-c271-49dc-bc8b-69cdc275e660\") "
Oct 30 22:00:36.308699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.308612    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70affa35-c271-49dc-bc8b-69cdc275e660-bundle\" (UniqueName: \"kubernetes.io/empty-dir/70affa35-c271-49dc-bc8b-69cdc275e660-bundle\") pod \"70affa35-c271-49dc-bc8b-69cdc275e660\" (UID: \"70affa35-c271-49dc-bc8b-69cdc275e660\") "
Oct 30 22:00:36.308699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.308641    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/70affa35-c271-49dc-bc8b-69cdc275e660-util\" (UniqueName: \"kubernetes.io/empty-dir/70affa35-c271-49dc-bc8b-69cdc275e660-util\") pod \"70affa35-c271-49dc-bc8b-69cdc275e660\" (UID: \"70affa35-c271-49dc-bc8b-69cdc275e660\") "
Oct 30 22:00:36.309050 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.309021    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70affa35-c271-49dc-bc8b-69cdc275e660-bundle" pod "70affa35-c271-49dc-bc8b-69cdc275e660" (UID: "70affa35-c271-49dc-bc8b-69cdc275e660"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:36.310627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.310582    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"
Oct 30 22:00:36.310727 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.310628    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70affa35-c271-49dc-bc8b-69cdc275e660-kube-api-access-dzgjp" pod "70affa35-c271-49dc-bc8b-69cdc275e660" (UID: "70affa35-c271-49dc-bc8b-69cdc275e660"). InnerVolumeSpecName "kube-api-access-dzgjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:36.314240 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.314220    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"
Oct 30 22:00:36.315299 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.315274    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70affa35-c271-49dc-bc8b-69cdc275e660-util" pod "70affa35-c271-49dc-bc8b-69cdc275e660" (UID: "70affa35-c271-49dc-bc8b-69cdc275e660"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:36.317309 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.317290    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"
Oct 30 22:00:36.409570 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.409503    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-bundle\") pod \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\" (UID: \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\") "
Oct 30 22:00:36.409570 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.409551    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-kube-api-access-sk72j\" (UniqueName: \"kubernetes.io/projected/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-kube-api-access-sk72j\") pod \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\" (UID: \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\") "
Oct 30 22:00:36.409899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.409606    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-util\" (UniqueName: \"kubernetes.io/empty-dir/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-util\") pod \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\" (UID: \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\") "
Oct 30 22:00:36.409899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.409628    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21cebb90-951e-4dbe-aef3-184c858d0767-util\" (UniqueName: \"kubernetes.io/empty-dir/21cebb90-951e-4dbe-aef3-184c858d0767-util\") pod \"21cebb90-951e-4dbe-aef3-184c858d0767\" (UID: \"21cebb90-951e-4dbe-aef3-184c858d0767\") "
Oct 30 22:00:36.409899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.409649    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-bundle\") pod \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\" (UID: \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\") "
Oct 30 22:00:36.409899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.409665    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-util\" (UniqueName: \"kubernetes.io/empty-dir/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-util\") pod \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\" (UID: \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\") "
Oct 30 22:00:36.409899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.409696    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21cebb90-951e-4dbe-aef3-184c858d0767-bundle\" (UniqueName: \"kubernetes.io/empty-dir/21cebb90-951e-4dbe-aef3-184c858d0767-bundle\") pod \"21cebb90-951e-4dbe-aef3-184c858d0767\" (UID: \"21cebb90-951e-4dbe-aef3-184c858d0767\") "
Oct 30 22:00:36.409899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.409719    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-kube-api-access-s92m6\" (UniqueName: \"kubernetes.io/projected/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-kube-api-access-s92m6\") pod \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\" (UID: \"0dd2c788-e997-4e58-89fb-d5a3f474cbf6\") "
Oct 30 22:00:36.409899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.409741    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21cebb90-951e-4dbe-aef3-184c858d0767-kube-api-access-drkxl\" (UniqueName: \"kubernetes.io/projected/21cebb90-951e-4dbe-aef3-184c858d0767-kube-api-access-drkxl\") pod \"21cebb90-951e-4dbe-aef3-184c858d0767\" (UID: \"21cebb90-951e-4dbe-aef3-184c858d0767\") "
Oct 30 22:00:36.409899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.409777    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-kube-api-access-tcz7r\" (UniqueName: \"kubernetes.io/projected/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-kube-api-access-tcz7r\") pod \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\" (UID: \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\") "
Oct 30 22:00:36.409899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.409837    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-bundle\") pod \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\" (UID: \"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5\") "
Oct 30 22:00:36.409899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.409896    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-util\" (UniqueName: \"kubernetes.io/empty-dir/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-util\") pod \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\" (UID: \"95e15c05-9c9a-4318-96c7-ffffe4ff31bf\") "
Oct 30 22:00:36.410406 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.410150    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzgjp\" (UniqueName: \"kubernetes.io/projected/70affa35-c271-49dc-bc8b-69cdc275e660-kube-api-access-dzgjp\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.410406 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.410170    5258 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70affa35-c271-49dc-bc8b-69cdc275e660-bundle\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.410406 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.410184    5258 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70affa35-c271-49dc-bc8b-69cdc275e660-util\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.410584 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.410499    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-bundle" pod "0dd2c788-e997-4e58-89fb-d5a3f474cbf6" (UID: "0dd2c788-e997-4e58-89fb-d5a3f474cbf6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:36.410584 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.410547    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-bundle" pod "95e15c05-9c9a-4318-96c7-ffffe4ff31bf" (UID: "95e15c05-9c9a-4318-96c7-ffffe4ff31bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:36.411461 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.411179    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21cebb90-951e-4dbe-aef3-184c858d0767-bundle" pod "21cebb90-951e-4dbe-aef3-184c858d0767" (UID: "21cebb90-951e-4dbe-aef3-184c858d0767"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:36.412306 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.412275    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-kube-api-access-sk72j" pod "95e15c05-9c9a-4318-96c7-ffffe4ff31bf" (UID: "95e15c05-9c9a-4318-96c7-ffffe4ff31bf"). InnerVolumeSpecName "kube-api-access-sk72j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:36.412910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.412805    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-bundle" pod "6ef76aa9-a05b-4089-8294-48d7ebb2b2f5" (UID: "6ef76aa9-a05b-4089-8294-48d7ebb2b2f5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:36.413062 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.413037    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21cebb90-951e-4dbe-aef3-184c858d0767-kube-api-access-drkxl" pod "21cebb90-951e-4dbe-aef3-184c858d0767" (UID: "21cebb90-951e-4dbe-aef3-184c858d0767"). InnerVolumeSpecName "kube-api-access-drkxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:36.413768 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.413742    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-kube-api-access-s92m6" pod "0dd2c788-e997-4e58-89fb-d5a3f474cbf6" (UID: "0dd2c788-e997-4e58-89fb-d5a3f474cbf6"). InnerVolumeSpecName "kube-api-access-s92m6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:36.413888 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.413873    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-kube-api-access-tcz7r" pod "6ef76aa9-a05b-4089-8294-48d7ebb2b2f5" (UID: "6ef76aa9-a05b-4089-8294-48d7ebb2b2f5"). InnerVolumeSpecName "kube-api-access-tcz7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:36.418320 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.418297    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-util" pod "6ef76aa9-a05b-4089-8294-48d7ebb2b2f5" (UID: "6ef76aa9-a05b-4089-8294-48d7ebb2b2f5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:36.418489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.418468    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21cebb90-951e-4dbe-aef3-184c858d0767-util" pod "21cebb90-951e-4dbe-aef3-184c858d0767" (UID: "21cebb90-951e-4dbe-aef3-184c858d0767"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:36.419415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.419393    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-util" pod "0dd2c788-e997-4e58-89fb-d5a3f474cbf6" (UID: "0dd2c788-e997-4e58-89fb-d5a3f474cbf6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:36.419541 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.419527    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-util" pod "95e15c05-9c9a-4318-96c7-ffffe4ff31bf" (UID: "95e15c05-9c9a-4318-96c7-ffffe4ff31bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:36.511540 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.511511    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drkxl\" (UniqueName: \"kubernetes.io/projected/21cebb90-951e-4dbe-aef3-184c858d0767-kube-api-access-drkxl\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.511540 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.511536    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcz7r\" (UniqueName: \"kubernetes.io/projected/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-kube-api-access-tcz7r\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.511704 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.511546    5258 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-bundle\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.511704 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.511554    5258 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-util\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.511704 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.511562    5258 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-bundle\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.511704 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.511569    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk72j\" (UniqueName: \"kubernetes.io/projected/95e15c05-9c9a-4318-96c7-ffffe4ff31bf-kube-api-access-sk72j\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.511704 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.511577    5258 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ef76aa9-a05b-4089-8294-48d7ebb2b2f5-util\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.511704 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.511608    5258 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21cebb90-951e-4dbe-aef3-184c858d0767-util\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.511704 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.511620    5258 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-bundle\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.511704 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.511626    5258 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-util\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.511704 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.511636    5258 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21cebb90-951e-4dbe-aef3-184c858d0767-bundle\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:36.511704 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:36.511644    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s92m6\" (UniqueName: \"kubernetes.io/projected/0dd2c788-e997-4e58-89fb-d5a3f474cbf6-kube-api-access-s92m6\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:37.093540 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.093513    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw"
Oct 30 22:00:37.093540 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.093510    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7fklsw" event={"ID":"0dd2c788-e997-4e58-89fb-d5a3f474cbf6","Type":"ContainerDied","Data":"59389f2b5db764232e1acb85ef2ab96ab6cbac35b16dc7af961ddc2fa5b864c2"}
Oct 30 22:00:37.094040 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.093574    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59389f2b5db764232e1acb85ef2ab96ab6cbac35b16dc7af961ddc2fa5b864c2"
Oct 30 22:00:37.095489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.095468    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb" event={"ID":"70affa35-c271-49dc-bc8b-69cdc275e660","Type":"ContainerDied","Data":"841e80bf7829c85056f7acf1e387980afa5b1035d5a875290e90ce6ef6bd6b94"}
Oct 30 22:00:37.095489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.095484    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dlqdb"
Oct 30 22:00:37.095690 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.095499    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="841e80bf7829c85056f7acf1e387980afa5b1035d5a875290e90ce6ef6bd6b94"
Oct 30 22:00:37.097404 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.097388    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x"
Oct 30 22:00:37.097516 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.097409    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71vcm6x" event={"ID":"21cebb90-951e-4dbe-aef3-184c858d0767","Type":"ContainerDied","Data":"1c94fb04cfcea91f1b854e6fffa628abd3f9d813745e5a981c28c72dc736cdf5"}
Oct 30 22:00:37.097516 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.097443    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c94fb04cfcea91f1b854e6fffa628abd3f9d813745e5a981c28c72dc736cdf5"
Oct 30 22:00:37.099462 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.099445    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827"
Oct 30 22:00:37.099462 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.099456    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cg7827" event={"ID":"95e15c05-9c9a-4318-96c7-ffffe4ff31bf","Type":"ContainerDied","Data":"3cce6072bba13b4c8e352b886be532b2150924f0f722f78179b6b1093eb01a09"}
Oct 30 22:00:37.099639 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.099487    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cce6072bba13b4c8e352b886be532b2150924f0f722f78179b6b1093eb01a09"
Oct 30 22:00:37.101501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.101482    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws" event={"ID":"6ef76aa9-a05b-4089-8294-48d7ebb2b2f5","Type":"ContainerDied","Data":"e8f8b6dbfa0372dbf27c13f03277ff8112baccdbcd72cf5696b18698bbc5d0cd"}
Oct 30 22:00:37.101618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.101512    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8f8b6dbfa0372dbf27c13f03277ff8112baccdbcd72cf5696b18698bbc5d0cd"
Oct 30 22:00:37.101618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.101522    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6q9kws"
Oct 30 22:00:37.199598 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.199563    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:37.434539 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:37.434458    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:43.159226 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:00:43.159184    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:00:44.621783 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:44.621750    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:45.128635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:45.128606    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:45.884399 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:45.884362    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:46.036569 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.036539    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"]
Oct 30 22:00:46.036939 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.036919    5258 cpu_manager.go:414] "containerMap: removing container" podUID="6ef76aa9-a05b-4089-8294-48d7ebb2b2f5" containerName="pull"
Oct 30 22:00:46.036939 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.036939    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ef76aa9-a05b-4089-8294-48d7ebb2b2f5" containerName="pull"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.036957    5258 cpu_manager.go:414] "containerMap: removing container" podUID="95e15c05-9c9a-4318-96c7-ffffe4ff31bf" containerName="pull"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.036964    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="95e15c05-9c9a-4318-96c7-ffffe4ff31bf" containerName="pull"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.036974    5258 cpu_manager.go:414] "containerMap: removing container" podUID="005b3f30-82f6-418c-9b2b-56430df557ba" containerName="extract"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.036981    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="005b3f30-82f6-418c-9b2b-56430df557ba" containerName="extract"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.036991    5258 cpu_manager.go:414] "containerMap: removing container" podUID="95e15c05-9c9a-4318-96c7-ffffe4ff31bf" containerName="extract"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.036998    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="95e15c05-9c9a-4318-96c7-ffffe4ff31bf" containerName="extract"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037012    5258 cpu_manager.go:414] "containerMap: removing container" podUID="21cebb90-951e-4dbe-aef3-184c858d0767" containerName="util"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037018    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21cebb90-951e-4dbe-aef3-184c858d0767" containerName="util"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037029    5258 cpu_manager.go:414] "containerMap: removing container" podUID="0dd2c788-e997-4e58-89fb-d5a3f474cbf6" containerName="pull"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037036    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0dd2c788-e997-4e58-89fb-d5a3f474cbf6" containerName="pull"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037047    5258 cpu_manager.go:414] "containerMap: removing container" podUID="21cebb90-951e-4dbe-aef3-184c858d0767" containerName="extract"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037054    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21cebb90-951e-4dbe-aef3-184c858d0767" containerName="extract"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037066    5258 cpu_manager.go:414] "containerMap: removing container" podUID="005b3f30-82f6-418c-9b2b-56430df557ba" containerName="util"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037074    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="005b3f30-82f6-418c-9b2b-56430df557ba" containerName="util"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037084    5258 cpu_manager.go:414] "containerMap: removing container" podUID="52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632" containerName="extract"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037090    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632" containerName="extract"
Oct 30 22:00:46.037094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037100    5258 cpu_manager.go:414] "containerMap: removing container" podUID="6ef76aa9-a05b-4089-8294-48d7ebb2b2f5" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037107    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ef76aa9-a05b-4089-8294-48d7ebb2b2f5" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037122    5258 cpu_manager.go:414] "containerMap: removing container" podUID="70affa35-c271-49dc-bc8b-69cdc275e660" containerName="pull"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037129    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="70affa35-c271-49dc-bc8b-69cdc275e660" containerName="pull"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037142    5258 cpu_manager.go:414] "containerMap: removing container" podUID="6ef76aa9-a05b-4089-8294-48d7ebb2b2f5" containerName="util"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037149    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ef76aa9-a05b-4089-8294-48d7ebb2b2f5" containerName="util"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037157    5258 cpu_manager.go:414] "containerMap: removing container" podUID="005b3f30-82f6-418c-9b2b-56430df557ba" containerName="pull"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037163    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="005b3f30-82f6-418c-9b2b-56430df557ba" containerName="pull"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037173    5258 cpu_manager.go:414] "containerMap: removing container" podUID="18765b3b-731c-4fee-90a2-37f73a020849" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037181    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18765b3b-731c-4fee-90a2-37f73a020849" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037190    5258 cpu_manager.go:414] "containerMap: removing container" podUID="52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632" containerName="pull"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037196    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632" containerName="pull"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037207    5258 cpu_manager.go:414] "containerMap: removing container" podUID="52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632" containerName="util"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037214    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632" containerName="util"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037223    5258 cpu_manager.go:414] "containerMap: removing container" podUID="70affa35-c271-49dc-bc8b-69cdc275e660" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037230    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="70affa35-c271-49dc-bc8b-69cdc275e660" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037241    5258 cpu_manager.go:414] "containerMap: removing container" podUID="18765b3b-731c-4fee-90a2-37f73a020849" containerName="pull"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037248    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18765b3b-731c-4fee-90a2-37f73a020849" containerName="pull"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037262    5258 cpu_manager.go:414] "containerMap: removing container" podUID="18765b3b-731c-4fee-90a2-37f73a020849" containerName="util"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037269    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18765b3b-731c-4fee-90a2-37f73a020849" containerName="util"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037283    5258 cpu_manager.go:414] "containerMap: removing container" podUID="21cebb90-951e-4dbe-aef3-184c858d0767" containerName="pull"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037290    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21cebb90-951e-4dbe-aef3-184c858d0767" containerName="pull"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037301    5258 cpu_manager.go:414] "containerMap: removing container" podUID="0dd2c788-e997-4e58-89fb-d5a3f474cbf6" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037307    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0dd2c788-e997-4e58-89fb-d5a3f474cbf6" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037326    5258 cpu_manager.go:414] "containerMap: removing container" podUID="95e15c05-9c9a-4318-96c7-ffffe4ff31bf" containerName="util"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037333    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="95e15c05-9c9a-4318-96c7-ffffe4ff31bf" containerName="util"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037344    5258 cpu_manager.go:414] "containerMap: removing container" podUID="0dd2c788-e997-4e58-89fb-d5a3f474cbf6" containerName="util"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037351    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0dd2c788-e997-4e58-89fb-d5a3f474cbf6" containerName="util"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037364    5258 cpu_manager.go:414] "containerMap: removing container" podUID="70affa35-c271-49dc-bc8b-69cdc275e660" containerName="util"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037371    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="70affa35-c271-49dc-bc8b-69cdc275e660" containerName="util"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037446    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="0dd2c788-e997-4e58-89fb-d5a3f474cbf6" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037460    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="95e15c05-9c9a-4318-96c7-ffffe4ff31bf" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037471    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="005b3f30-82f6-418c-9b2b-56430df557ba" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037480    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="21cebb90-951e-4dbe-aef3-184c858d0767" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037490    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="52a0a167-a6bb-4c50-a2b0-eaf7cb5a1632" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037498    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ef76aa9-a05b-4089-8294-48d7ebb2b2f5" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037510    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="18765b3b-731c-4fee-90a2-37f73a020849" containerName="extract"
Oct 30 22:00:46.037922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.037518    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="70affa35-c271-49dc-bc8b-69cdc275e660" containerName="extract"
Oct 30 22:00:46.041083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.041065    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.094700 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.094676    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 22:00:46.094818 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.094723    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-9rb8f\""
Oct 30 22:00:46.094818 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.094766    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 22:00:46.143538 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.143485    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 22:00:46.143538 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.143509    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 22:00:46.143538 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.143513    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 22:00:46.163835 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.163806    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"]
Oct 30 22:00:46.183555 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.183532    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/113eccb8-5316-4cfd-96b8-839be8fa732d-tmp\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.183682 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.183568    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksnpl\" (UniqueName: \"kubernetes.io/projected/113eccb8-5316-4cfd-96b8-839be8fa732d-kube-api-access-ksnpl\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.183682 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.183605    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/113eccb8-5316-4cfd-96b8-839be8fa732d-webhook-cert\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.183682 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.183670    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/113eccb8-5316-4cfd-96b8-839be8fa732d-manifests\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.183784 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.183720    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/113eccb8-5316-4cfd-96b8-839be8fa732d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.183784 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.183772    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/113eccb8-5316-4cfd-96b8-839be8fa732d-metrics-cert\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.255238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.255213    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:46.284759 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.284732    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/113eccb8-5316-4cfd-96b8-839be8fa732d-tmp\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.284855 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.284776    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksnpl\" (UniqueName: \"kubernetes.io/projected/113eccb8-5316-4cfd-96b8-839be8fa732d-kube-api-access-ksnpl\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.284855 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.284797    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/113eccb8-5316-4cfd-96b8-839be8fa732d-webhook-cert\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.284855 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.284829    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/113eccb8-5316-4cfd-96b8-839be8fa732d-manifests\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.285011 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.284871    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/113eccb8-5316-4cfd-96b8-839be8fa732d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.285011 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.284896    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/113eccb8-5316-4cfd-96b8-839be8fa732d-metrics-cert\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.285250 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.285226    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/113eccb8-5316-4cfd-96b8-839be8fa732d-manifests\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.287177 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.287151    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/113eccb8-5316-4cfd-96b8-839be8fa732d-tmp\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.287282 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.287261    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/113eccb8-5316-4cfd-96b8-839be8fa732d-webhook-cert\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.287340 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.287280    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/113eccb8-5316-4cfd-96b8-839be8fa732d-metrics-cert\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.287395 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.287361    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/113eccb8-5316-4cfd-96b8-839be8fa732d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.346937 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.346909    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksnpl\" (UniqueName: \"kubernetes.io/projected/113eccb8-5316-4cfd-96b8-839be8fa732d-kube-api-access-ksnpl\") pod \"opendatahub-operator-controller-manager-f7fbfb566-l9wvc\" (UID: \"113eccb8-5316-4cfd-96b8-839be8fa732d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.353756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.353736    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:46.550516 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.550436    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:46.775645 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:46.775547    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:47.015246 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:47.015209    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"]
Oct 30 22:00:47.020910 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:00:47.020883    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113eccb8_5316_4cfd_96b8_839be8fa732d.slice/crio-87c33fddce912f13bf673285aced58cf7a1a2f0a012afe9193762b9a39287852 WatchSource:0}: Error finding container 87c33fddce912f13bf673285aced58cf7a1a2f0a012afe9193762b9a39287852: Status 404 returned error can't find the container with id 87c33fddce912f13bf673285aced58cf7a1a2f0a012afe9193762b9a39287852
Oct 30 22:00:47.145345 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:47.145314    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc" event={"ID":"113eccb8-5316-4cfd-96b8-839be8fa732d","Type":"ContainerStarted","Data":"87c33fddce912f13bf673285aced58cf7a1a2f0a012afe9193762b9a39287852"}
Oct 30 22:00:48.630234 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:48.630197    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:49.707541 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:49.707501    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:50.417565 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:50.417501    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:51.167927 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.167895    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc" event={"ID":"113eccb8-5316-4cfd-96b8-839be8fa732d","Type":"ContainerStarted","Data":"553eac08ed80d862805968d345ce2c59eeb38d78606f5fed7772176fa4bb10ad"}
Oct 30 22:00:51.202574 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.202552    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj"]
Oct 30 22:00:51.204858 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.204843    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj"
Oct 30 22:00:51.222149 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.222130    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj"]
Oct 30 22:00:51.299935 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.299914    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mnb5f\""
Oct 30 22:00:51.300174 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.300157    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 30 22:00:51.300216 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.300172    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 30 22:00:51.326625 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.326604    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91466a72-3684-40cf-9cbc-8bb08e128d5d-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj\" (UID: \"91466a72-3684-40cf-9cbc-8bb08e128d5d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj"
Oct 30 22:00:51.326750 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.326735    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shlkp\" (UniqueName: \"kubernetes.io/projected/91466a72-3684-40cf-9cbc-8bb08e128d5d-kube-api-access-shlkp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj\" (UID: \"91466a72-3684-40cf-9cbc-8bb08e128d5d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj"
Oct 30 22:00:51.427897 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.427838    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shlkp\" (UniqueName: \"kubernetes.io/projected/91466a72-3684-40cf-9cbc-8bb08e128d5d-kube-api-access-shlkp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj\" (UID: \"91466a72-3684-40cf-9cbc-8bb08e128d5d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj"
Oct 30 22:00:51.427897 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.427886    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91466a72-3684-40cf-9cbc-8bb08e128d5d-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj\" (UID: \"91466a72-3684-40cf-9cbc-8bb08e128d5d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj"
Oct 30 22:00:51.428197 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.428183    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91466a72-3684-40cf-9cbc-8bb08e128d5d-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj\" (UID: \"91466a72-3684-40cf-9cbc-8bb08e128d5d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj"
Oct 30 22:00:51.494610 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.494562    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shlkp\" (UniqueName: \"kubernetes.io/projected/91466a72-3684-40cf-9cbc-8bb08e128d5d-kube-api-access-shlkp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj\" (UID: \"91466a72-3684-40cf-9cbc-8bb08e128d5d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj"
Oct 30 22:00:51.533222 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.533199    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj"
Oct 30 22:00:51.972491 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:51.972463    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj"]
Oct 30 22:00:51.974910 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:00:51.974881    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91466a72_3684_40cf_9cbc_8bb08e128d5d.slice/crio-a874fb1b7648f600efd648f2b3eae872e94c1438c1f1d12a1612a3e5238f0e0b WatchSource:0}: Error finding container a874fb1b7648f600efd648f2b3eae872e94c1438c1f1d12a1612a3e5238f0e0b: Status 404 returned error can't find the container with id a874fb1b7648f600efd648f2b3eae872e94c1438c1f1d12a1612a3e5238f0e0b
Oct 30 22:00:52.173640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:52.173608    5258 generic.go:356] "Generic (PLEG): container finished" podID="113eccb8-5316-4cfd-96b8-839be8fa732d" containerID="553eac08ed80d862805968d345ce2c59eeb38d78606f5fed7772176fa4bb10ad" exitCode=0
Oct 30 22:00:52.174032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:52.173687    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc" event={"ID":"113eccb8-5316-4cfd-96b8-839be8fa732d","Type":"ContainerDied","Data":"553eac08ed80d862805968d345ce2c59eeb38d78606f5fed7772176fa4bb10ad"}
Oct 30 22:00:52.174032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:52.173744    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc" event={"ID":"113eccb8-5316-4cfd-96b8-839be8fa732d","Type":"ContainerStarted","Data":"0164a1d5652472da3f241d4922e1930dee9248b1ab6bd0f2d2399c2724d482ba"}
Oct 30 22:00:52.174032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:52.173860    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:00:52.175153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:52.175131    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj" event={"ID":"91466a72-3684-40cf-9cbc-8bb08e128d5d","Type":"ContainerStarted","Data":"a874fb1b7648f600efd648f2b3eae872e94c1438c1f1d12a1612a3e5238f0e0b"}
Oct 30 22:00:52.321133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:52.321085    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc" podStartSLOduration=2.412258996 podStartE2EDuration="7.321069784s" totalImagesPullingTime="4.433938724s" totalInitContainerRuntime="474.872064ms" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:52.318764261 +0000 UTC m=+367.049621403" watchObservedRunningTime="2026-10-30 22:00:52.321069784 +0000 UTC m=+367.051926923"
Oct 30 22:00:54.488124 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:54.488080    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:54.887320 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:54.887283    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:55.197164 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:55.197071    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj" event={"ID":"91466a72-3684-40cf-9cbc-8bb08e128d5d","Type":"ContainerStarted","Data":"bae4a2cadeeb54758342c54ae5ea825089c6273220c2ae25f523bbdea311bb1c"}
Oct 30 22:00:55.466401 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:55.466301    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dcxdj" podStartSLOduration=1.8665039399999999 podStartE2EDuration="4.466288513s" totalImagesPullingTime="2.599784573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:55.416685212 +0000 UTC m=+370.147542374" watchObservedRunningTime="2026-10-30 22:00:55.466288513 +0000 UTC m=+370.197145656"
Oct 30 22:00:55.566516 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:55.566485    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:56.412301 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:56.412264    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:56.690423 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:56.690337    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:58.627156 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:58.627119    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:58.964301 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:58.964219    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:59.198480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.198449    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-57bcq"]
Oct 30 22:00:59.201033 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.201017    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-57bcq"
Oct 30 22:00:59.255712 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.255650    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 30 22:00:59.278856 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.278833    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:59.294896 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.294869    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rrmb\" (UniqueName: \"kubernetes.io/projected/14cfcea5-b9eb-4554-9788-a5f45a3cb7d7-kube-api-access-2rrmb\") pod \"cert-manager-cainjector-5c57bbd4fc-57bcq\" (UID: \"14cfcea5-b9eb-4554-9788-a5f45a3cb7d7\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-57bcq"
Oct 30 22:00:59.295001 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.294948    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14cfcea5-b9eb-4554-9788-a5f45a3cb7d7-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-57bcq\" (UID: \"14cfcea5-b9eb-4554-9788-a5f45a3cb7d7\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-57bcq"
Oct 30 22:00:59.303179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.303158    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 30 22:00:59.303296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.303279    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-j2fns\""
Oct 30 22:00:59.304982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.304960    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-57bcq"]
Oct 30 22:00:59.395605 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.395563    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14cfcea5-b9eb-4554-9788-a5f45a3cb7d7-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-57bcq\" (UID: \"14cfcea5-b9eb-4554-9788-a5f45a3cb7d7\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-57bcq"
Oct 30 22:00:59.395735 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.395629    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rrmb\" (UniqueName: \"kubernetes.io/projected/14cfcea5-b9eb-4554-9788-a5f45a3cb7d7-kube-api-access-2rrmb\") pod \"cert-manager-cainjector-5c57bbd4fc-57bcq\" (UID: \"14cfcea5-b9eb-4554-9788-a5f45a3cb7d7\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-57bcq"
Oct 30 22:00:59.468165 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.468128    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14cfcea5-b9eb-4554-9788-a5f45a3cb7d7-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-57bcq\" (UID: \"14cfcea5-b9eb-4554-9788-a5f45a3cb7d7\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-57bcq"
Oct 30 22:00:59.468326 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.468307    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rrmb\" (UniqueName: \"kubernetes.io/projected/14cfcea5-b9eb-4554-9788-a5f45a3cb7d7-kube-api-access-2rrmb\") pod \"cert-manager-cainjector-5c57bbd4fc-57bcq\" (UID: \"14cfcea5-b9eb-4554-9788-a5f45a3cb7d7\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-57bcq"
Oct 30 22:00:59.520724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.520668    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-57bcq"
Oct 30 22:00:59.823687 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.823652    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:59.895678 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:00:59.895555    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-57bcq"]
Oct 30 22:00:59.898624 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:00:59.898570    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14cfcea5_b9eb_4554_9788_a5f45a3cb7d7.slice/crio-317dabf2f8948895bc20ac5aa28bab246b0606e014d5b4a4d865c38538f03364 WatchSource:0}: Error finding container 317dabf2f8948895bc20ac5aa28bab246b0606e014d5b4a4d865c38538f03364: Status 404 returned error can't find the container with id 317dabf2f8948895bc20ac5aa28bab246b0606e014d5b4a4d865c38538f03364
Oct 30 22:01:00.219486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:00.219405    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-57bcq" event={"ID":"14cfcea5-b9eb-4554-9788-a5f45a3cb7d7","Type":"ContainerStarted","Data":"317dabf2f8948895bc20ac5aa28bab246b0606e014d5b4a4d865c38538f03364"}
Oct 30 22:01:01.070293 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:01.070261    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:03.183194 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:03.183165    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-f7fbfb566-l9wvc"
Oct 30 22:01:03.902135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:03.902099    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:04.172632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:04.172572    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:04.240115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:04.240072    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-57bcq" event={"ID":"14cfcea5-b9eb-4554-9788-a5f45a3cb7d7","Type":"ContainerStarted","Data":"9c91807fc371da2a295e1dcdea6c901a18e793447113c3ec26059a536481c868"}
Oct 30 22:01:04.364142 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:04.364087    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-57bcq" podStartSLOduration=1.6021576830000002 podStartE2EDuration="5.364071986s" totalImagesPullingTime="3.761914303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:04.36328122 +0000 UTC m=+379.094138366" watchObservedRunningTime="2026-10-30 22:01:04.364071986 +0000 UTC m=+379.094929128"
Oct 30 22:01:06.553041 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:06.553008    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"]
Oct 30 22:01:06.556354 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:06.556338    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"
Oct 30 22:01:06.609352 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:06.609326    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"]
Oct 30 22:01:06.643981 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:06.643955    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7e9e93a-5d6a-47f7-a82f-a19b265840cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-vjfwx\" (UID: \"f7e9e93a-5d6a-47f7-a82f-a19b265840cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"
Oct 30 22:01:06.644086 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:06.643997    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99s2d\" (UniqueName: \"kubernetes.io/projected/f7e9e93a-5d6a-47f7-a82f-a19b265840cf-kube-api-access-99s2d\") pod \"kuadrant-operator-controller-manager-cf8469d7b-vjfwx\" (UID: \"f7e9e93a-5d6a-47f7-a82f-a19b265840cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"
Oct 30 22:01:06.657003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:06.656971    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 22:01:06.657076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:06.657021    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8t5r7\""
Oct 30 22:01:06.657076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:06.657023    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 22:01:06.744887 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:06.744856    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7e9e93a-5d6a-47f7-a82f-a19b265840cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-vjfwx\" (UID: \"f7e9e93a-5d6a-47f7-a82f-a19b265840cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"
Oct 30 22:01:06.745034 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:06.744910    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99s2d\" (UniqueName: \"kubernetes.io/projected/f7e9e93a-5d6a-47f7-a82f-a19b265840cf-kube-api-access-99s2d\") pod \"kuadrant-operator-controller-manager-cf8469d7b-vjfwx\" (UID: \"f7e9e93a-5d6a-47f7-a82f-a19b265840cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"
Oct 30 22:01:06.745337 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:06.745319    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7e9e93a-5d6a-47f7-a82f-a19b265840cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-vjfwx\" (UID: \"f7e9e93a-5d6a-47f7-a82f-a19b265840cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"
Oct 30 22:01:06.818296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:06.818263    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99s2d\" (UniqueName: \"kubernetes.io/projected/f7e9e93a-5d6a-47f7-a82f-a19b265840cf-kube-api-access-99s2d\") pod \"kuadrant-operator-controller-manager-cf8469d7b-vjfwx\" (UID: \"f7e9e93a-5d6a-47f7-a82f-a19b265840cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"
Oct 30 22:01:06.858328 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:06.858284    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:06.868085 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:06.868062    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"
Oct 30 22:01:07.162009 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:07.161936    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:07.366400 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:07.366370    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"]
Oct 30 22:01:07.423466 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:01:07.423440    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e9e93a_5d6a_47f7_a82f_a19b265840cf.slice/crio-cb06ecc6f85b01b5ab1a04306327744980f97087ffc0c14a0565e7d84a1e39af WatchSource:0}: Error finding container cb06ecc6f85b01b5ab1a04306327744980f97087ffc0c14a0565e7d84a1e39af: Status 404 returned error can't find the container with id cb06ecc6f85b01b5ab1a04306327744980f97087ffc0c14a0565e7d84a1e39af
Oct 30 22:01:07.459928 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:07.459901    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:08.260281 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:08.260245    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx" event={"ID":"f7e9e93a-5d6a-47f7-a82f-a19b265840cf","Type":"ContainerStarted","Data":"cb06ecc6f85b01b5ab1a04306327744980f97087ffc0c14a0565e7d84a1e39af"}
Oct 30 22:01:08.555572 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:08.555485    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:08.864225 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:08.864188    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:10.121766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:10.121664    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:10.642283 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:10.640620    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-5s6rv"]
Oct 30 22:01:10.647638 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:10.647608    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-5s6rv"
Oct 30 22:01:10.670210 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:10.670183    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87r9z\" (UniqueName: \"kubernetes.io/projected/799ab849-b5eb-4121-b968-daac6c0ca192-kube-api-access-87r9z\") pod \"authorino-operator-7b7bb4bc77-5s6rv\" (UID: \"799ab849-b5eb-4121-b968-daac6c0ca192\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-5s6rv"
Oct 30 22:01:10.750030 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:10.749996    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-znh68\""
Oct 30 22:01:10.756064 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:10.756032    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-5s6rv"]
Oct 30 22:01:10.771297 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:10.771261    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87r9z\" (UniqueName: \"kubernetes.io/projected/799ab849-b5eb-4121-b968-daac6c0ca192-kube-api-access-87r9z\") pod \"authorino-operator-7b7bb4bc77-5s6rv\" (UID: \"799ab849-b5eb-4121-b968-daac6c0ca192\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-5s6rv"
Oct 30 22:01:10.834568 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:10.834539    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87r9z\" (UniqueName: \"kubernetes.io/projected/799ab849-b5eb-4121-b968-daac6c0ca192-kube-api-access-87r9z\") pod \"authorino-operator-7b7bb4bc77-5s6rv\" (UID: \"799ab849-b5eb-4121-b968-daac6c0ca192\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-5s6rv"
Oct 30 22:01:10.966088 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:10.966011    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-5s6rv"
Oct 30 22:01:11.383424 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:11.383398    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-5s6rv"]
Oct 30 22:01:11.386653 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:01:11.386619    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod799ab849_b5eb_4121_b968_daac6c0ca192.slice/crio-aa1ec9457ba94b4379f1cc1d1f921dc75f33fd8506b367c6c1928c3decabbea8 WatchSource:0}: Error finding container aa1ec9457ba94b4379f1cc1d1f921dc75f33fd8506b367c6c1928c3decabbea8: Status 404 returned error can't find the container with id aa1ec9457ba94b4379f1cc1d1f921dc75f33fd8506b367c6c1928c3decabbea8
Oct 30 22:01:11.824145 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:11.824110    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:12.086885 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:12.086801    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:12.287042 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:12.287003    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-5s6rv" event={"ID":"799ab849-b5eb-4121-b968-daac6c0ca192","Type":"ContainerStarted","Data":"aa1ec9457ba94b4379f1cc1d1f921dc75f33fd8506b367c6c1928c3decabbea8"}
Oct 30 22:01:13.166511 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:01:13.166470    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:01:13.295178 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:13.294638    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx" event={"ID":"f7e9e93a-5d6a-47f7-a82f-a19b265840cf","Type":"ContainerStarted","Data":"8bde44ec2e30148f047850486b8310ddf3029a8ad0b18963feb876a7a0cc9a76"}
Oct 30 22:01:13.295178 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:13.294929    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"
Oct 30 22:01:13.471223 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:13.471122    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx" podStartSLOduration=2.294187551 podStartE2EDuration="7.47110365s" totalImagesPullingTime="5.176916099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:13.469928242 +0000 UTC m=+388.200785386" watchObservedRunningTime="2026-10-30 22:01:13.47110365 +0000 UTC m=+388.201960795"
Oct 30 22:01:14.022127 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:14.022099    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-mssbp"]
Oct 30 22:01:14.025411 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:14.025387    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mssbp"
Oct 30 22:01:14.078906 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:14.078877    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6wclk\""
Oct 30 22:01:14.079290 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:14.079273    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Oct 30 22:01:14.098732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:14.098708    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4pvn\" (UniqueName: \"kubernetes.io/projected/3f26245d-8748-43ec-b93b-aae4d677f50a-kube-api-access-b4pvn\") pod \"dns-operator-controller-manager-8557cbdb84-mssbp\" (UID: \"3f26245d-8748-43ec-b93b-aae4d677f50a\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mssbp"
Oct 30 22:01:14.132402 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:14.132376    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-mssbp"]
Oct 30 22:01:14.200092 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:14.200045    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4pvn\" (UniqueName: \"kubernetes.io/projected/3f26245d-8748-43ec-b93b-aae4d677f50a-kube-api-access-b4pvn\") pod \"dns-operator-controller-manager-8557cbdb84-mssbp\" (UID: \"3f26245d-8748-43ec-b93b-aae4d677f50a\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mssbp"
Oct 30 22:01:14.262915 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:14.262887    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4pvn\" (UniqueName: \"kubernetes.io/projected/3f26245d-8748-43ec-b93b-aae4d677f50a-kube-api-access-b4pvn\") pod \"dns-operator-controller-manager-8557cbdb84-mssbp\" (UID: \"3f26245d-8748-43ec-b93b-aae4d677f50a\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mssbp"
Oct 30 22:01:14.301292 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:14.301257    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-5s6rv" event={"ID":"799ab849-b5eb-4121-b968-daac6c0ca192","Type":"ContainerStarted","Data":"d9ffa9f2bfd878729d786fcdfd2e1e97fe91707f06395b00f4bdd4fd4d40f853"}
Oct 30 22:01:14.301430 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:14.301336    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-5s6rv"
Oct 30 22:01:14.338118 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:14.338047    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mssbp"
Oct 30 22:01:14.423566 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:14.423518    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-5s6rv" podStartSLOduration=2.017546723 podStartE2EDuration="4.423501409s" totalImagesPullingTime="2.405954686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:14.422293873 +0000 UTC m=+389.153151018" watchObservedRunningTime="2026-10-30 22:01:14.423501409 +0000 UTC m=+389.154358553"
Oct 30 22:01:14.679401 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:14.679319    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:14.723038 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:14.723016    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-mssbp"]
Oct 30 22:01:14.725581 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:01:14.725552    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f26245d_8748_43ec_b93b_aae4d677f50a.slice/crio-8f085480002c89d753866a408803ed6f4f5ebc25b3e5403102482c4ac430f1be WatchSource:0}: Error finding container 8f085480002c89d753866a408803ed6f4f5ebc25b3e5403102482c4ac430f1be: Status 404 returned error can't find the container with id 8f085480002c89d753866a408803ed6f4f5ebc25b3e5403102482c4ac430f1be
Oct 30 22:01:15.307181 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:15.307140    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mssbp" event={"ID":"3f26245d-8748-43ec-b93b-aae4d677f50a","Type":"ContainerStarted","Data":"8f085480002c89d753866a408803ed6f4f5ebc25b3e5403102482c4ac430f1be"}
Oct 30 22:01:16.013180 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:16.013145    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-ckfcw"]
Oct 30 22:01:16.017731 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:16.017711    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-ckfcw"
Oct 30 22:01:16.116844 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:16.116816    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx6kq\" (UniqueName: \"kubernetes.io/projected/1d2ccf23-0efa-409e-8815-c53ea93de343-kube-api-access-jx6kq\") pod \"limitador-operator-controller-manager-5778bb4449-ckfcw\" (UID: \"1d2ccf23-0efa-409e-8815-c53ea93de343\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-ckfcw"
Oct 30 22:01:16.119660 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:16.119638    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-t8fqh\""
Oct 30 22:01:16.121332 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:16.121309    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-ckfcw"]
Oct 30 22:01:16.217493 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:16.217461    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6kq\" (UniqueName: \"kubernetes.io/projected/1d2ccf23-0efa-409e-8815-c53ea93de343-kube-api-access-jx6kq\") pod \"limitador-operator-controller-manager-5778bb4449-ckfcw\" (UID: \"1d2ccf23-0efa-409e-8815-c53ea93de343\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-ckfcw"
Oct 30 22:01:16.287583 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:16.287514    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx6kq\" (UniqueName: \"kubernetes.io/projected/1d2ccf23-0efa-409e-8815-c53ea93de343-kube-api-access-jx6kq\") pod \"limitador-operator-controller-manager-5778bb4449-ckfcw\" (UID: \"1d2ccf23-0efa-409e-8815-c53ea93de343\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-ckfcw"
Oct 30 22:01:16.331452 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:16.331420    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-ckfcw"
Oct 30 22:01:16.588479 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:16.588444    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:16.767113 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:16.767085    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-ckfcw"]
Oct 30 22:01:16.769848 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:01:16.769805    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2ccf23_0efa_409e_8815_c53ea93de343.slice/crio-0f77f23f0aa7393aeb9950377cfc64fa01245f33a99c892536d9e796fc66faad WatchSource:0}: Error finding container 0f77f23f0aa7393aeb9950377cfc64fa01245f33a99c892536d9e796fc66faad: Status 404 returned error can't find the container with id 0f77f23f0aa7393aeb9950377cfc64fa01245f33a99c892536d9e796fc66faad
Oct 30 22:01:17.318819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:17.318791    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mssbp" event={"ID":"3f26245d-8748-43ec-b93b-aae4d677f50a","Type":"ContainerStarted","Data":"856cc69702ff9f13af32946660253d4f03f4e5484bcdf565148bde0b12d52f25"}
Oct 30 22:01:17.318930 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:17.318856    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mssbp"
Oct 30 22:01:17.320079 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:17.320054    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-ckfcw" event={"ID":"1d2ccf23-0efa-409e-8815-c53ea93de343","Type":"ContainerStarted","Data":"0f77f23f0aa7393aeb9950377cfc64fa01245f33a99c892536d9e796fc66faad"}
Oct 30 22:01:17.337778 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:17.337751    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:17.459745 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:17.459691    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mssbp" podStartSLOduration=1.930776906 podStartE2EDuration="4.459677029s" totalImagesPullingTime="2.528900123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:17.458332733 +0000 UTC m=+392.189189878" watchObservedRunningTime="2026-10-30 22:01:17.459677029 +0000 UTC m=+392.190534173"
Oct 30 22:01:17.601311 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:17.601275    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:18.258134 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:18.258096    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:18.599186 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:18.599092    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:20.073525 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:20.073484    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:20.341814 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:20.341736    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-ckfcw" event={"ID":"1d2ccf23-0efa-409e-8815-c53ea93de343","Type":"ContainerStarted","Data":"66564deab0e9a35f5966d5e6a699137536478c64af27ee0359c58f2175acecf1"}
Oct 30 22:01:20.341958 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:20.341891    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-ckfcw"
Oct 30 22:01:20.354523 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:20.354495    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:20.470807 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:20.470752    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-ckfcw" podStartSLOduration=2.891814711 podStartE2EDuration="5.470737039s" totalImagesPullingTime="2.578922328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:20.4685571 +0000 UTC m=+395.199414239" watchObservedRunningTime="2026-10-30 22:01:20.470737039 +0000 UTC m=+395.201594175"
Oct 30 22:01:20.591952 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:20.591860    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:20.840502 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:20.840461    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:21.091702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:21.091678    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:23.445646 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:23.445611    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:23.686286 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:23.686258    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:23.979275 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:23.979230    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:24.304499 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:24.304430    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"
Oct 30 22:01:25.173454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:25.173423    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"]
Oct 30 22:01:25.184144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:25.184115    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"
Oct 30 22:01:25.287867 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:25.287836    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"]
Oct 30 22:01:25.292238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:25.292204    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prxb4\" (UniqueName: \"kubernetes.io/projected/ffbba870-a25b-4779-80c2-e907a8912908-kube-api-access-prxb4\") pod \"kuadrant-operator-controller-manager-678d87766f-89n5q\" (UID: \"ffbba870-a25b-4779-80c2-e907a8912908\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"
Oct 30 22:01:25.292358 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:25.292271    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffbba870-a25b-4779-80c2-e907a8912908-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-89n5q\" (UID: \"ffbba870-a25b-4779-80c2-e907a8912908\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"
Oct 30 22:01:25.309937 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:25.309911    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-5s6rv"
Oct 30 22:01:25.393719 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:25.393688    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffbba870-a25b-4779-80c2-e907a8912908-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-89n5q\" (UID: \"ffbba870-a25b-4779-80c2-e907a8912908\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"
Oct 30 22:01:25.393873 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:25.393754    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prxb4\" (UniqueName: \"kubernetes.io/projected/ffbba870-a25b-4779-80c2-e907a8912908-kube-api-access-prxb4\") pod \"kuadrant-operator-controller-manager-678d87766f-89n5q\" (UID: \"ffbba870-a25b-4779-80c2-e907a8912908\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"
Oct 30 22:01:25.394251 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:25.394227    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffbba870-a25b-4779-80c2-e907a8912908-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-89n5q\" (UID: \"ffbba870-a25b-4779-80c2-e907a8912908\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"
Oct 30 22:01:25.461139 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:25.461070    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prxb4\" (UniqueName: \"kubernetes.io/projected/ffbba870-a25b-4779-80c2-e907a8912908-kube-api-access-prxb4\") pod \"kuadrant-operator-controller-manager-678d87766f-89n5q\" (UID: \"ffbba870-a25b-4779-80c2-e907a8912908\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"
Oct 30 22:01:25.495273 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:25.495241    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"
Oct 30 22:01:25.565540 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:25.565499    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:25.805554 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:25.805473    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:25.926858 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:25.926832    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"]
Oct 30 22:01:25.929515 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:01:25.929481    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffbba870_a25b_4779_80c2_e907a8912908.slice/crio-1cea0f7b6444f68d07f671bda25566cafa8b24ae995c89996defb325380ae586 WatchSource:0}: Error finding container 1cea0f7b6444f68d07f671bda25566cafa8b24ae995c89996defb325380ae586: Status 404 returned error can't find the container with id 1cea0f7b6444f68d07f671bda25566cafa8b24ae995c89996defb325380ae586
Oct 30 22:01:26.133346 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.133316    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:26.166692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.166665    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"]
Oct 30 22:01:26.168846 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.168824    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.201532 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.201507    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.201928 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.201539    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.201928 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.201563    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.201928 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.201736    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.201928 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.201776    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.201928 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.201810    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.201928 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.201922    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.202144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.201944    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xws6\" (UniqueName: \"kubernetes.io/projected/ab30c3fd-f2e8-413e-b837-c295e91f4f84-kube-api-access-4xws6\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.202144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.202021    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.303107 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.303074    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.303276 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.303129    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.303276 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.303241    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.303391 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.303288    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.303391 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.303323    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.303391 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.303352    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.303537 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.303503    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.303537 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.303518    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.303664 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.303623    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.303821 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.303792    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.303940 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.303857    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.303940 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.303916    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.303940 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.303938    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xws6\" (UniqueName: \"kubernetes.io/projected/ab30c3fd-f2e8-413e-b837-c295e91f4f84-kube-api-access-4xws6\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.304604 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.304568    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.305923 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.305903    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.305997 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.305969    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.330405 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.330382    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"]
Oct 30 22:01:26.339136 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.339114    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qpp9m\""
Oct 30 22:01:26.370342 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.370316    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab30c3fd-f2e8-413e-b837-c295e91f4f84-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.370461 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.370405    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xws6\" (UniqueName: \"kubernetes.io/projected/ab30c3fd-f2e8-413e-b837-c295e91f4f84-kube-api-access-4xws6\") pod \"data-science-gateway-data-science-gateway-class-6545b48489p5m4v\" (UID: \"ab30c3fd-f2e8-413e-b837-c295e91f4f84\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.372865 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.372841    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q" event={"ID":"ffbba870-a25b-4779-80c2-e907a8912908","Type":"ContainerStarted","Data":"7c83659890137182836c8b9be2949c43c01a6df4468a8b7d321be43b8348a7e3"}
Oct 30 22:01:26.372982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.372901    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q" event={"ID":"ffbba870-a25b-4779-80c2-e907a8912908","Type":"ContainerStarted","Data":"1cea0f7b6444f68d07f671bda25566cafa8b24ae995c89996defb325380ae586"}
Oct 30 22:01:26.372982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.372924    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"
Oct 30 22:01:26.451507 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.451440    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:26.479786 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.479758    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:26.507453 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.507391    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q" podStartSLOduration=1.507371601 podStartE2EDuration="1.507371601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:26.505321953 +0000 UTC m=+401.236179096" watchObservedRunningTime="2026-10-30 22:01:26.507371601 +0000 UTC m=+401.238228746"
Oct 30 22:01:26.727354 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.727275    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:26.871911 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.871617    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"]
Oct 30 22:01:26.878369 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.878340    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:01:26.878453 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.878407    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:01:26.878453 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:26.878435    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:01:27.380706 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:27.380665    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v" event={"ID":"ab30c3fd-f2e8-413e-b837-c295e91f4f84","Type":"ContainerStarted","Data":"f503b9bb1fda13163a69f09a4bb50926594e9c17159aa9e743e7011746838172"}
Oct 30 22:01:27.381125 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:27.380736    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v" event={"ID":"ab30c3fd-f2e8-413e-b837-c295e91f4f84","Type":"ContainerStarted","Data":"58630af86eca4921b0e3da11397d157b0231948f05352aefc20182b9d5a1c2cb"}
Oct 30 22:01:27.480521 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:27.480485    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:27.485443 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:27.485421    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:27.503455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:27.503408    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v" podStartSLOduration=1.503394981 podStartE2EDuration="1.503394981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:27.501392204 +0000 UTC m=+402.232249349" watchObservedRunningTime="2026-10-30 22:01:27.503394981 +0000 UTC m=+402.234252123"
Oct 30 22:01:28.328665 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:28.328637    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mssbp"
Oct 30 22:01:28.385412 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:28.385382    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:28.386771 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:28.386753    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6545b48489p5m4v"
Oct 30 22:01:29.091254 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:29.091218    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:29.326135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:29.326102    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:31.348728 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:31.348694    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-ckfcw"
Oct 30 22:01:31.504797 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:31.504764    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:31.791372 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:31.791291    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:33.381000 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:33.380967    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:35.908524 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:35.908490    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:36.171244 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:36.171166    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:36.390058 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:36.390025    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:36.986878 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:36.986839    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:37.276283 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:37.276200    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:37.383539 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:37.383513    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"
Oct 30 22:01:37.606827 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:37.606784    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"]
Oct 30 22:01:37.607056 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:37.607027    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx" podUID="f7e9e93a-5d6a-47f7-a82f-a19b265840cf" containerName="manager" containerID="cri-o://8bde44ec2e30148f047850486b8310ddf3029a8ad0b18963feb876a7a0cc9a76" gracePeriod=10
Oct 30 22:01:37.851365 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:37.851343    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"
Oct 30 22:01:37.905432 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:37.905370    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7e9e93a-5d6a-47f7-a82f-a19b265840cf-kube-api-access-99s2d\" (UniqueName: \"kubernetes.io/projected/f7e9e93a-5d6a-47f7-a82f-a19b265840cf-kube-api-access-99s2d\") pod \"f7e9e93a-5d6a-47f7-a82f-a19b265840cf\" (UID: \"f7e9e93a-5d6a-47f7-a82f-a19b265840cf\") "
Oct 30 22:01:37.905556 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:37.905440    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7e9e93a-5d6a-47f7-a82f-a19b265840cf-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7e9e93a-5d6a-47f7-a82f-a19b265840cf-extensions-socket-volume\") pod \"f7e9e93a-5d6a-47f7-a82f-a19b265840cf\" (UID: \"f7e9e93a-5d6a-47f7-a82f-a19b265840cf\") "
Oct 30 22:01:37.905933 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:37.905912    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7e9e93a-5d6a-47f7-a82f-a19b265840cf-extensions-socket-volume" pod "f7e9e93a-5d6a-47f7-a82f-a19b265840cf" (UID: "f7e9e93a-5d6a-47f7-a82f-a19b265840cf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:01:37.907492 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:37.907462    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7e9e93a-5d6a-47f7-a82f-a19b265840cf-kube-api-access-99s2d" pod "f7e9e93a-5d6a-47f7-a82f-a19b265840cf" (UID: "f7e9e93a-5d6a-47f7-a82f-a19b265840cf"). InnerVolumeSpecName "kube-api-access-99s2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:01:38.006211 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.006182    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99s2d\" (UniqueName: \"kubernetes.io/projected/f7e9e93a-5d6a-47f7-a82f-a19b265840cf-kube-api-access-99s2d\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:38.006211 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.006206    5258 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7e9e93a-5d6a-47f7-a82f-a19b265840cf-extensions-socket-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:01:38.441527 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.441492    5258 generic.go:356] "Generic (PLEG): container finished" podID="f7e9e93a-5d6a-47f7-a82f-a19b265840cf" containerID="8bde44ec2e30148f047850486b8310ddf3029a8ad0b18963feb876a7a0cc9a76" exitCode=0
Oct 30 22:01:38.441758 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.441532    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx" event={"ID":"f7e9e93a-5d6a-47f7-a82f-a19b265840cf","Type":"ContainerDied","Data":"8bde44ec2e30148f047850486b8310ddf3029a8ad0b18963feb876a7a0cc9a76"}
Oct 30 22:01:38.441758 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.441550    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"
Oct 30 22:01:38.441758 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.441629    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx" event={"ID":"f7e9e93a-5d6a-47f7-a82f-a19b265840cf","Type":"ContainerDied","Data":"cb06ecc6f85b01b5ab1a04306327744980f97087ffc0c14a0565e7d84a1e39af"}
Oct 30 22:01:38.441758 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.441659    5258 scope.go:122] "RemoveContainer" containerID="8bde44ec2e30148f047850486b8310ddf3029a8ad0b18963feb876a7a0cc9a76"
Oct 30 22:01:38.452108 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.452088    5258 scope.go:122] "RemoveContainer" containerID="8bde44ec2e30148f047850486b8310ddf3029a8ad0b18963feb876a7a0cc9a76"
Oct 30 22:01:38.452424 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:01:38.452402    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bde44ec2e30148f047850486b8310ddf3029a8ad0b18963feb876a7a0cc9a76\": container with ID starting with 8bde44ec2e30148f047850486b8310ddf3029a8ad0b18963feb876a7a0cc9a76 not found: ID does not exist" containerID="8bde44ec2e30148f047850486b8310ddf3029a8ad0b18963feb876a7a0cc9a76"
Oct 30 22:01:38.452494 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.452433    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bde44ec2e30148f047850486b8310ddf3029a8ad0b18963feb876a7a0cc9a76"} err="failed to get container status \"8bde44ec2e30148f047850486b8310ddf3029a8ad0b18963feb876a7a0cc9a76\": rpc error: code = NotFound desc = could not find container \"8bde44ec2e30148f047850486b8310ddf3029a8ad0b18963feb876a7a0cc9a76\": container with ID starting with 8bde44ec2e30148f047850486b8310ddf3029a8ad0b18963feb876a7a0cc9a76 not found: ID does not exist"
Oct 30 22:01:38.551815 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.551779    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-d5h5h"]
Oct 30 22:01:38.552169 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.552155    5258 cpu_manager.go:414] "containerMap: removing container" podUID="f7e9e93a-5d6a-47f7-a82f-a19b265840cf" containerName="manager"
Oct 30 22:01:38.552211 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.552170    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7e9e93a-5d6a-47f7-a82f-a19b265840cf" containerName="manager"
Oct 30 22:01:38.552245 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.552222    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7e9e93a-5d6a-47f7-a82f-a19b265840cf" containerName="manager"
Oct 30 22:01:38.554909 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.554887    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-d5h5h"
Oct 30 22:01:38.591562 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.591533    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-d5h5h"]
Oct 30 22:01:38.611635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.611605    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rgmm\" (UniqueName: \"kubernetes.io/projected/ecf55c06-0158-4b86-9a1b-8a1d3916e94f-kube-api-access-6rgmm\") pod \"authorino-57f7f8659f-d5h5h\" (UID: \"ecf55c06-0158-4b86-9a1b-8a1d3916e94f\") " pod="kuadrant-system/authorino-57f7f8659f-d5h5h"
Oct 30 22:01:38.612433 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.612415    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bgjpl\""
Oct 30 22:01:38.620937 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.620913    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"]
Oct 30 22:01:38.663619 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.663580    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-vjfwx"]
Oct 30 22:01:38.712511 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.712439    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rgmm\" (UniqueName: \"kubernetes.io/projected/ecf55c06-0158-4b86-9a1b-8a1d3916e94f-kube-api-access-6rgmm\") pod \"authorino-57f7f8659f-d5h5h\" (UID: \"ecf55c06-0158-4b86-9a1b-8a1d3916e94f\") " pod="kuadrant-system/authorino-57f7f8659f-d5h5h"
Oct 30 22:01:38.742441 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.742411    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:38.775404 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.775377    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rgmm\" (UniqueName: \"kubernetes.io/projected/ecf55c06-0158-4b86-9a1b-8a1d3916e94f-kube-api-access-6rgmm\") pod \"authorino-57f7f8659f-d5h5h\" (UID: \"ecf55c06-0158-4b86-9a1b-8a1d3916e94f\") " pod="kuadrant-system/authorino-57f7f8659f-d5h5h"
Oct 30 22:01:38.866300 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:38.866265    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-d5h5h"
Oct 30 22:01:39.053579 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:39.053491    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:39.247640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:39.247563    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-d5h5h"]
Oct 30 22:01:39.250351 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:01:39.250314    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecf55c06_0158_4b86_9a1b_8a1d3916e94f.slice/crio-fb9b089675d7f89f4b9a42cf48093b139cfc86fe5b7cf333bd5dae52b3435ea1 WatchSource:0}: Error finding container fb9b089675d7f89f4b9a42cf48093b139cfc86fe5b7cf333bd5dae52b3435ea1: Status 404 returned error can't find the container with id fb9b089675d7f89f4b9a42cf48093b139cfc86fe5b7cf333bd5dae52b3435ea1
Oct 30 22:01:39.379118 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:39.379083    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f7e9e93a-5d6a-47f7-a82f-a19b265840cf" path="/var/lib/kubelet/pods/f7e9e93a-5d6a-47f7-a82f-a19b265840cf/volumes"
Oct 30 22:01:39.448276 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:39.448238    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-d5h5h" event={"ID":"ecf55c06-0158-4b86-9a1b-8a1d3916e94f","Type":"ContainerStarted","Data":"fb9b089675d7f89f4b9a42cf48093b139cfc86fe5b7cf333bd5dae52b3435ea1"}
Oct 30 22:01:42.316489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:42.316447    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:42.658372 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:42.658284    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:43.161017 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:01:43.160983    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:01:43.470736 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:43.470655    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-d5h5h" event={"ID":"ecf55c06-0158-4b86-9a1b-8a1d3916e94f","Type":"ContainerStarted","Data":"0820fbb1861c348aac513ead4231715acf70297fd40970d37fda48718215ffa6"}
Oct 30 22:01:43.593039 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:43.592988    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-d5h5h" podStartSLOduration=2.436886338 podStartE2EDuration="5.592975724s" totalImagesPullingTime="3.156089386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:43.591933528 +0000 UTC m=+418.322790671" watchObservedRunningTime="2026-10-30 22:01:43.592975724 +0000 UTC m=+418.323832867"
Oct 30 22:01:48.529789 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:48.529749    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:48.801920 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:48.801840    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:50.135852 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:50.135816    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:50.378156 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:50.378122    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:52.578317 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:52.578281    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:52.792388 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:52.792358    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:56.081973 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:56.081937    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-p57ht"]
Oct 30 22:01:56.085652 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:56.085633    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-p57ht"
Oct 30 22:01:56.162900 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:56.159356    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-p57ht"]
Oct 30 22:01:56.266656 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:56.266615    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98krc\" (UniqueName: \"kubernetes.io/projected/3607842c-3ddd-4f53-9c48-c5af16d872b8-kube-api-access-98krc\") pod \"authorino-56c6c9ddd5-p57ht\" (UID: \"3607842c-3ddd-4f53-9c48-c5af16d872b8\") " pod="kuadrant-system/authorino-56c6c9ddd5-p57ht"
Oct 30 22:01:56.341544 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:56.341462    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:56.367495 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:56.367461    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98krc\" (UniqueName: \"kubernetes.io/projected/3607842c-3ddd-4f53-9c48-c5af16d872b8-kube-api-access-98krc\") pod \"authorino-56c6c9ddd5-p57ht\" (UID: \"3607842c-3ddd-4f53-9c48-c5af16d872b8\") " pod="kuadrant-system/authorino-56c6c9ddd5-p57ht"
Oct 30 22:01:56.430211 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:56.430177    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98krc\" (UniqueName: \"kubernetes.io/projected/3607842c-3ddd-4f53-9c48-c5af16d872b8-kube-api-access-98krc\") pod \"authorino-56c6c9ddd5-p57ht\" (UID: \"3607842c-3ddd-4f53-9c48-c5af16d872b8\") " pod="kuadrant-system/authorino-56c6c9ddd5-p57ht"
Oct 30 22:01:56.696061 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:56.695981    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-p57ht"
Oct 30 22:01:57.068290 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:57.068267    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-p57ht"]
Oct 30 22:01:57.070984 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:01:57.070953    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3607842c_3ddd_4f53_9c48_c5af16d872b8.slice/crio-7f5a7a5dce9cc35e322ae799abf42c4e465f880b00e074be4cd39b607891b4a2 WatchSource:0}: Error finding container 7f5a7a5dce9cc35e322ae799abf42c4e465f880b00e074be4cd39b607891b4a2: Status 404 returned error can't find the container with id 7f5a7a5dce9cc35e322ae799abf42c4e465f880b00e074be4cd39b607891b4a2
Oct 30 22:01:57.354037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:57.353951    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:57.542661 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:57.542581    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-p57ht" event={"ID":"3607842c-3ddd-4f53-9c48-c5af16d872b8","Type":"ContainerStarted","Data":"7f5a7a5dce9cc35e322ae799abf42c4e465f880b00e074be4cd39b607891b4a2"}
Oct 30 22:01:57.621877 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:57.621786    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:59.456038 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.456008    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:01:59.458543 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.458520    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"
Oct 30 22:01:59.512485 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.512463    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 30 22:01:59.554410 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.554376    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-p57ht" event={"ID":"3607842c-3ddd-4f53-9c48-c5af16d872b8","Type":"ContainerStarted","Data":"68d5d07b2c42307e317341eb5c48f76b2d6a89900f57fd5d1f2369a3d52a68f8"}
Oct 30 22:01:59.560912 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.560893    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-m79jn\""
Oct 30 22:01:59.563021 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.562996    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:01:59.599209 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.599185    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/87aca691-d489-4340-bba8-c2a24ef6b01a-config-file\") pod \"limitador-limitador-7c9b87d574-wpvvx\" (UID: \"87aca691-d489-4340-bba8-c2a24ef6b01a\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"
Oct 30 22:01:59.599301 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.599244    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd4f9\" (UniqueName: \"kubernetes.io/projected/87aca691-d489-4340-bba8-c2a24ef6b01a-kube-api-access-gd4f9\") pod \"limitador-limitador-7c9b87d574-wpvvx\" (UID: \"87aca691-d489-4340-bba8-c2a24ef6b01a\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"
Oct 30 22:01:59.694617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.694545    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-p57ht" podStartSLOduration=2.229564408 podStartE2EDuration="3.694526484s" totalImagesPullingTime="1.464962076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:59.690792164 +0000 UTC m=+434.421649309" watchObservedRunningTime="2026-10-30 22:01:59.694526484 +0000 UTC m=+434.425383628"
Oct 30 22:01:59.699765 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.699736    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd4f9\" (UniqueName: \"kubernetes.io/projected/87aca691-d489-4340-bba8-c2a24ef6b01a-kube-api-access-gd4f9\") pod \"limitador-limitador-7c9b87d574-wpvvx\" (UID: \"87aca691-d489-4340-bba8-c2a24ef6b01a\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"
Oct 30 22:01:59.699900 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.699807    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/87aca691-d489-4340-bba8-c2a24ef6b01a-config-file\") pod \"limitador-limitador-7c9b87d574-wpvvx\" (UID: \"87aca691-d489-4340-bba8-c2a24ef6b01a\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"
Oct 30 22:01:59.700415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.700391    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/87aca691-d489-4340-bba8-c2a24ef6b01a-config-file\") pod \"limitador-limitador-7c9b87d574-wpvvx\" (UID: \"87aca691-d489-4340-bba8-c2a24ef6b01a\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"
Oct 30 22:01:59.721892 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.721821    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-d5h5h"]
Oct 30 22:01:59.722081 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.722046    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-d5h5h" podUID="ecf55c06-0158-4b86-9a1b-8a1d3916e94f" containerName="authorino" containerID="cri-o://0820fbb1861c348aac513ead4231715acf70297fd40970d37fda48718215ffa6" gracePeriod=30
Oct 30 22:01:59.762239 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.762202    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd4f9\" (UniqueName: \"kubernetes.io/projected/87aca691-d489-4340-bba8-c2a24ef6b01a-kube-api-access-gd4f9\") pod \"limitador-limitador-7c9b87d574-wpvvx\" (UID: \"87aca691-d489-4340-bba8-c2a24ef6b01a\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"
Oct 30 22:01:59.763139 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.763114    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:01:59.769340 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.769321    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"
Oct 30 22:01:59.968142 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:01:59.968119    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-d5h5h"
Oct 30 22:02:00.102988 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:00.102935    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ecf55c06-0158-4b86-9a1b-8a1d3916e94f-kube-api-access-6rgmm\" (UniqueName: \"kubernetes.io/projected/ecf55c06-0158-4b86-9a1b-8a1d3916e94f-kube-api-access-6rgmm\") pod \"ecf55c06-0158-4b86-9a1b-8a1d3916e94f\" (UID: \"ecf55c06-0158-4b86-9a1b-8a1d3916e94f\") "
Oct 30 22:02:00.105021 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:00.104993    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecf55c06-0158-4b86-9a1b-8a1d3916e94f-kube-api-access-6rgmm" pod "ecf55c06-0158-4b86-9a1b-8a1d3916e94f" (UID: "ecf55c06-0158-4b86-9a1b-8a1d3916e94f"). InnerVolumeSpecName "kube-api-access-6rgmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:02:00.150373 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:00.150346    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:02:00.152317 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:02:00.152290    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87aca691_d489_4340_bba8_c2a24ef6b01a.slice/crio-164566e71735744e24d011894293b275e0049eaca828999ad053a53409558b98 WatchSource:0}: Error finding container 164566e71735744e24d011894293b275e0049eaca828999ad053a53409558b98: Status 404 returned error can't find the container with id 164566e71735744e24d011894293b275e0049eaca828999ad053a53409558b98
Oct 30 22:02:00.204055 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:00.204032    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rgmm\" (UniqueName: \"kubernetes.io/projected/ecf55c06-0158-4b86-9a1b-8a1d3916e94f-kube-api-access-6rgmm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:02:00.561184 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:00.561150    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-wpvvx" event={"ID":"87aca691-d489-4340-bba8-c2a24ef6b01a","Type":"ContainerStarted","Data":"164566e71735744e24d011894293b275e0049eaca828999ad053a53409558b98"}
Oct 30 22:02:00.562353 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:00.562317    5258 generic.go:356] "Generic (PLEG): container finished" podID="ecf55c06-0158-4b86-9a1b-8a1d3916e94f" containerID="0820fbb1861c348aac513ead4231715acf70297fd40970d37fda48718215ffa6" exitCode=0
Oct 30 22:02:00.562470 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:00.562360    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-d5h5h"
Oct 30 22:02:00.562470 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:00.562403    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-d5h5h" event={"ID":"ecf55c06-0158-4b86-9a1b-8a1d3916e94f","Type":"ContainerDied","Data":"0820fbb1861c348aac513ead4231715acf70297fd40970d37fda48718215ffa6"}
Oct 30 22:02:00.562470 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:00.562441    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-d5h5h" event={"ID":"ecf55c06-0158-4b86-9a1b-8a1d3916e94f","Type":"ContainerDied","Data":"fb9b089675d7f89f4b9a42cf48093b139cfc86fe5b7cf333bd5dae52b3435ea1"}
Oct 30 22:02:00.562470 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:00.562465    5258 scope.go:122] "RemoveContainer" containerID="0820fbb1861c348aac513ead4231715acf70297fd40970d37fda48718215ffa6"
Oct 30 22:02:00.571098 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:00.571082    5258 scope.go:122] "RemoveContainer" containerID="0820fbb1861c348aac513ead4231715acf70297fd40970d37fda48718215ffa6"
Oct 30 22:02:00.571327 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:02:00.571313    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0820fbb1861c348aac513ead4231715acf70297fd40970d37fda48718215ffa6\": container with ID starting with 0820fbb1861c348aac513ead4231715acf70297fd40970d37fda48718215ffa6 not found: ID does not exist" containerID="0820fbb1861c348aac513ead4231715acf70297fd40970d37fda48718215ffa6"
Oct 30 22:02:00.571374 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:00.571336    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0820fbb1861c348aac513ead4231715acf70297fd40970d37fda48718215ffa6"} err="failed to get container status \"0820fbb1861c348aac513ead4231715acf70297fd40970d37fda48718215ffa6\": rpc error: code = NotFound desc = could not find container \"0820fbb1861c348aac513ead4231715acf70297fd40970d37fda48718215ffa6\": container with ID starting with 0820fbb1861c348aac513ead4231715acf70297fd40970d37fda48718215ffa6 not found: ID does not exist"
Oct 30 22:02:00.727690 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:00.727657    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-d5h5h"]
Oct 30 22:02:00.733100 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:00.733078    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-d5h5h"]
Oct 30 22:02:01.379683 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:01.379654    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ecf55c06-0158-4b86-9a1b-8a1d3916e94f" path="/var/lib/kubelet/pods/ecf55c06-0158-4b86-9a1b-8a1d3916e94f/volumes"
Oct 30 22:02:02.527439 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:02.527358    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:02.575264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:02.575222    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-wpvvx" event={"ID":"87aca691-d489-4340-bba8-c2a24ef6b01a","Type":"ContainerStarted","Data":"da7194bbd089abe226483bdcc56bcfd650212737f04bb781b20394ac1a1cf11d"}
Oct 30 22:02:02.575438 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:02.575373    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"
Oct 30 22:02:02.700708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:02.700654    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-wpvvx" podStartSLOduration=1.655615053 podStartE2EDuration="3.700637657s" totalImagesPullingTime="2.045022604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:02.700355236 +0000 UTC m=+437.431212357" watchObservedRunningTime="2026-10-30 22:02:02.700637657 +0000 UTC m=+437.431494799"
Oct 30 22:02:02.769027 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:02.768988    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:02.986429 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:02.986394    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:03.211737 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:03.211695    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:11.552792 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:11.552750    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:11.835854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:11.835822    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:13.161022 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:02:13.160985    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:02:13.581694 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:13.581666    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"
Oct 30 22:02:14.021139 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:14.021060    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:14.380997 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:14.380963    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:17.638152 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:17.638121    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:18.859036 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:18.858999    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:19.130514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:19.130425    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:22.151779 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:22.151737    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:22.441333 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:22.441247    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:22.850550 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:22.850521    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:43.159392 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:02:43.159315    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:02:45.365459 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.365428    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-579cf7c6d-j7fcn"]
Oct 30 22:02:45.366003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.365981    5258 cpu_manager.go:414] "containerMap: removing container" podUID="ecf55c06-0158-4b86-9a1b-8a1d3916e94f" containerName="authorino"
Oct 30 22:02:45.366103 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.366006    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ecf55c06-0158-4b86-9a1b-8a1d3916e94f" containerName="authorino"
Oct 30 22:02:45.366158 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.366122    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="ecf55c06-0158-4b86-9a1b-8a1d3916e94f" containerName="authorino"
Oct 30 22:02:45.368377 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.368356    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:02:45.403426 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.403398    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:45.421130 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.421113    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 22:02:45.421225 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.421126    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 22:02:45.452800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.452780    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c747eb50-d833-40d9-8a2f-da94f3145aeb-metrics-certs\") pod \"maas-controller-579cf7c6d-j7fcn\" (UID: \"c747eb50-d833-40d9-8a2f-da94f3145aeb\") " pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:02:45.452894 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.452830    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zc9g\" (UniqueName: \"kubernetes.io/projected/c747eb50-d833-40d9-8a2f-da94f3145aeb-kube-api-access-7zc9g\") pod \"maas-controller-579cf7c6d-j7fcn\" (UID: \"c747eb50-d833-40d9-8a2f-da94f3145aeb\") " pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:02:45.452894 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.452851    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c747eb50-d833-40d9-8a2f-da94f3145aeb-webhook-cert\") pod \"maas-controller-579cf7c6d-j7fcn\" (UID: \"c747eb50-d833-40d9-8a2f-da94f3145aeb\") " pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:02:45.470262 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.470239    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fstvf\""
Oct 30 22:02:45.470771 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.470753    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 22:02:45.470867 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.470756    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 22:02:45.470867 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.470778    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 22:02:45.472840 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.472817    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-j7fcn"]
Oct 30 22:02:45.553619 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.553577    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c747eb50-d833-40d9-8a2f-da94f3145aeb-metrics-certs\") pod \"maas-controller-579cf7c6d-j7fcn\" (UID: \"c747eb50-d833-40d9-8a2f-da94f3145aeb\") " pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:02:45.553837 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.553664    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zc9g\" (UniqueName: \"kubernetes.io/projected/c747eb50-d833-40d9-8a2f-da94f3145aeb-kube-api-access-7zc9g\") pod \"maas-controller-579cf7c6d-j7fcn\" (UID: \"c747eb50-d833-40d9-8a2f-da94f3145aeb\") " pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:02:45.553837 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.553689    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c747eb50-d833-40d9-8a2f-da94f3145aeb-webhook-cert\") pod \"maas-controller-579cf7c6d-j7fcn\" (UID: \"c747eb50-d833-40d9-8a2f-da94f3145aeb\") " pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:02:45.556019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.555985    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c747eb50-d833-40d9-8a2f-da94f3145aeb-webhook-cert\") pod \"maas-controller-579cf7c6d-j7fcn\" (UID: \"c747eb50-d833-40d9-8a2f-da94f3145aeb\") " pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:02:45.556136 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.556031    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c747eb50-d833-40d9-8a2f-da94f3145aeb-metrics-certs\") pod \"maas-controller-579cf7c6d-j7fcn\" (UID: \"c747eb50-d833-40d9-8a2f-da94f3145aeb\") " pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:02:45.616323 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.616258    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zc9g\" (UniqueName: \"kubernetes.io/projected/c747eb50-d833-40d9-8a2f-da94f3145aeb-kube-api-access-7zc9g\") pod \"maas-controller-579cf7c6d-j7fcn\" (UID: \"c747eb50-d833-40d9-8a2f-da94f3145aeb\") " pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:02:45.679495 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.679466    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:02:45.757964 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:45.757932    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:46.003540 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:46.003463    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:46.069248 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:46.069220    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-j7fcn"]
Oct 30 22:02:46.095266 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:02:46.095239    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc747eb50_d833_40d9_8a2f_da94f3145aeb.slice/crio-7ad99b3943909047be3e91c4891995e8e9997c5b411d48be3c8b2eca7c9756a2 WatchSource:0}: Error finding container 7ad99b3943909047be3e91c4891995e8e9997c5b411d48be3c8b2eca7c9756a2: Status 404 returned error can't find the container with id 7ad99b3943909047be3e91c4891995e8e9997c5b411d48be3c8b2eca7c9756a2
Oct 30 22:02:46.792402 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:46.792371    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-j7fcn" event={"ID":"c747eb50-d833-40d9-8a2f-da94f3145aeb","Type":"ContainerStarted","Data":"7ad99b3943909047be3e91c4891995e8e9997c5b411d48be3c8b2eca7c9756a2"}
Oct 30 22:02:47.554826 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:47.554786    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:47.776325 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:47.776290    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:48.024083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.023992    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:48.279537 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.279466    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:48.505865 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.505818    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:48.760560 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.760527    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:48.764507 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.764481    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-zfzcp"]
Oct 30 22:02:48.767843 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.767819    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-zfzcp"
Oct 30 22:02:48.869711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.869683    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-d699b\""
Oct 30 22:02:48.869878 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.869791    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Oct 30 22:02:48.870158 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.870138    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Oct 30 22:02:48.872989 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.872967    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-zfzcp"]
Oct 30 22:02:48.882157 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.882129    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkn4s\" (UniqueName: \"kubernetes.io/projected/bf99aba5-45ba-42f2-bb30-daa7ee024580-kube-api-access-xkn4s\") pod \"odh-model-controller-769875db56-zfzcp\" (UID: \"bf99aba5-45ba-42f2-bb30-daa7ee024580\") " pod="opendatahub/odh-model-controller-769875db56-zfzcp"
Oct 30 22:02:48.882260 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.882200    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf99aba5-45ba-42f2-bb30-daa7ee024580-cert\") pod \"odh-model-controller-769875db56-zfzcp\" (UID: \"bf99aba5-45ba-42f2-bb30-daa7ee024580\") " pod="opendatahub/odh-model-controller-769875db56-zfzcp"
Oct 30 22:02:48.882330 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.882296    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf99aba5-45ba-42f2-bb30-daa7ee024580-metrics-certs\") pod \"odh-model-controller-769875db56-zfzcp\" (UID: \"bf99aba5-45ba-42f2-bb30-daa7ee024580\") " pod="opendatahub/odh-model-controller-769875db56-zfzcp"
Oct 30 22:02:48.983258 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.983224    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf99aba5-45ba-42f2-bb30-daa7ee024580-metrics-certs\") pod \"odh-model-controller-769875db56-zfzcp\" (UID: \"bf99aba5-45ba-42f2-bb30-daa7ee024580\") " pod="opendatahub/odh-model-controller-769875db56-zfzcp"
Oct 30 22:02:48.983407 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.983284    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkn4s\" (UniqueName: \"kubernetes.io/projected/bf99aba5-45ba-42f2-bb30-daa7ee024580-kube-api-access-xkn4s\") pod \"odh-model-controller-769875db56-zfzcp\" (UID: \"bf99aba5-45ba-42f2-bb30-daa7ee024580\") " pod="opendatahub/odh-model-controller-769875db56-zfzcp"
Oct 30 22:02:48.983407 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.983363    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf99aba5-45ba-42f2-bb30-daa7ee024580-cert\") pod \"odh-model-controller-769875db56-zfzcp\" (UID: \"bf99aba5-45ba-42f2-bb30-daa7ee024580\") " pod="opendatahub/odh-model-controller-769875db56-zfzcp"
Oct 30 22:02:48.986095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.986058    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf99aba5-45ba-42f2-bb30-daa7ee024580-cert\") pod \"odh-model-controller-769875db56-zfzcp\" (UID: \"bf99aba5-45ba-42f2-bb30-daa7ee024580\") " pod="opendatahub/odh-model-controller-769875db56-zfzcp"
Oct 30 22:02:48.986239 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:48.986120    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf99aba5-45ba-42f2-bb30-daa7ee024580-metrics-certs\") pod \"odh-model-controller-769875db56-zfzcp\" (UID: \"bf99aba5-45ba-42f2-bb30-daa7ee024580\") " pod="opendatahub/odh-model-controller-769875db56-zfzcp"
Oct 30 22:02:49.055260 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:49.055191    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkn4s\" (UniqueName: \"kubernetes.io/projected/bf99aba5-45ba-42f2-bb30-daa7ee024580-kube-api-access-xkn4s\") pod \"odh-model-controller-769875db56-zfzcp\" (UID: \"bf99aba5-45ba-42f2-bb30-daa7ee024580\") " pod="opendatahub/odh-model-controller-769875db56-zfzcp"
Oct 30 22:02:49.082580 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:49.082551    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-zfzcp"
Oct 30 22:02:49.461493 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:49.461469    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-zfzcp"]
Oct 30 22:02:49.464360 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:02:49.464332    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf99aba5_45ba_42f2_bb30_daa7ee024580.slice/crio-b297634055d721b01e17690beac220747e2bf050c2fab3ed068a941998ac048d WatchSource:0}: Error finding container b297634055d721b01e17690beac220747e2bf050c2fab3ed068a941998ac048d: Status 404 returned error can't find the container with id b297634055d721b01e17690beac220747e2bf050c2fab3ed068a941998ac048d
Oct 30 22:02:49.566650 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:49.566619    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:49.809280 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:49.809247    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-zfzcp" event={"ID":"bf99aba5-45ba-42f2-bb30-daa7ee024580","Type":"ContainerStarted","Data":"b297634055d721b01e17690beac220747e2bf050c2fab3ed068a941998ac048d"}
Oct 30 22:02:49.810708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:49.810681    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-j7fcn" event={"ID":"c747eb50-d833-40d9-8a2f-da94f3145aeb","Type":"ContainerStarted","Data":"a1824b2b49211957da2d62fed0ca99d180ebe3b2276d78e6c75c93d58826f9f9"}
Oct 30 22:02:49.810816 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:49.810765    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:02:49.837050 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:49.837029    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:49.932827 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:49.932783    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-579cf7c6d-j7fcn" podStartSLOduration=1.944643546 podStartE2EDuration="4.932770223s" totalImagesPullingTime="2.988126677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:49.931765476 +0000 UTC m=+484.662622618" watchObservedRunningTime="2026-10-30 22:02:49.932770223 +0000 UTC m=+484.663627362"
Oct 30 22:02:50.109083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:50.109013    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:52.832712 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:52.832670    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-zfzcp" event={"ID":"bf99aba5-45ba-42f2-bb30-daa7ee024580","Type":"ContainerStarted","Data":"d88075f4443ebfe59a433663de56bc963fcbdfdbbf509ce907f6be573c3a1a1c"}
Oct 30 22:02:52.833138 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:52.832775    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-zfzcp"
Oct 30 22:02:52.957212 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:52.957162    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-zfzcp" podStartSLOduration=2.046563754 podStartE2EDuration="4.957148626s" totalImagesPullingTime="2.910584872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:52.955266668 +0000 UTC m=+487.686123813" watchObservedRunningTime="2026-10-30 22:02:52.957148626 +0000 UTC m=+487.688005768"
Oct 30 22:02:53.287772 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:53.287694    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:53.547843 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:53.547750    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:55.282449 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:55.282412    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:55.603684 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:55.603655    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:55.826035 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:55.825993    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:56.059174 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:56.059143    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:56.288319 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:56.288290    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:56.503886 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:02:56.503796    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:00.820450 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:00.820415    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:03:01.296778 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.296697    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-j7fcn"]
Oct 30 22:03:01.296977 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.296948    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-579cf7c6d-j7fcn" podUID="c747eb50-d833-40d9-8a2f-da94f3145aeb" containerName="manager" containerID="cri-o://a1824b2b49211957da2d62fed0ca99d180ebe3b2276d78e6c75c93d58826f9f9" gracePeriod=30
Oct 30 22:03:01.544790 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.544760    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:03:01.697060 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.697025    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c747eb50-d833-40d9-8a2f-da94f3145aeb-kube-api-access-7zc9g\" (UniqueName: \"kubernetes.io/projected/c747eb50-d833-40d9-8a2f-da94f3145aeb-kube-api-access-7zc9g\") pod \"c747eb50-d833-40d9-8a2f-da94f3145aeb\" (UID: \"c747eb50-d833-40d9-8a2f-da94f3145aeb\") "
Oct 30 22:03:01.697247 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.697141    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c747eb50-d833-40d9-8a2f-da94f3145aeb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c747eb50-d833-40d9-8a2f-da94f3145aeb-metrics-certs\") pod \"c747eb50-d833-40d9-8a2f-da94f3145aeb\" (UID: \"c747eb50-d833-40d9-8a2f-da94f3145aeb\") "
Oct 30 22:03:01.697247 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.697167    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c747eb50-d833-40d9-8a2f-da94f3145aeb-webhook-cert\" (UniqueName: \"kubernetes.io/secret/c747eb50-d833-40d9-8a2f-da94f3145aeb-webhook-cert\") pod \"c747eb50-d833-40d9-8a2f-da94f3145aeb\" (UID: \"c747eb50-d833-40d9-8a2f-da94f3145aeb\") "
Oct 30 22:03:01.699356 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.699322    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c747eb50-d833-40d9-8a2f-da94f3145aeb-metrics-certs" pod "c747eb50-d833-40d9-8a2f-da94f3145aeb" (UID: "c747eb50-d833-40d9-8a2f-da94f3145aeb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:03:01.699356 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.699340    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c747eb50-d833-40d9-8a2f-da94f3145aeb-webhook-cert" pod "c747eb50-d833-40d9-8a2f-da94f3145aeb" (UID: "c747eb50-d833-40d9-8a2f-da94f3145aeb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:03:01.699504 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.699370    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c747eb50-d833-40d9-8a2f-da94f3145aeb-kube-api-access-7zc9g" pod "c747eb50-d833-40d9-8a2f-da94f3145aeb" (UID: "c747eb50-d833-40d9-8a2f-da94f3145aeb"). InnerVolumeSpecName "kube-api-access-7zc9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:03:01.798020 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.797992    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zc9g\" (UniqueName: \"kubernetes.io/projected/c747eb50-d833-40d9-8a2f-da94f3145aeb-kube-api-access-7zc9g\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:01.798020 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.798017    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c747eb50-d833-40d9-8a2f-da94f3145aeb-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:01.798020 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.798028    5258 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c747eb50-d833-40d9-8a2f-da94f3145aeb-webhook-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:01.878780 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.878741    5258 generic.go:356] "Generic (PLEG): container finished" podID="c747eb50-d833-40d9-8a2f-da94f3145aeb" containerID="a1824b2b49211957da2d62fed0ca99d180ebe3b2276d78e6c75c93d58826f9f9" exitCode=0
Oct 30 22:03:01.879233 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.878787    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-j7fcn"
Oct 30 22:03:01.879233 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.878820    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-j7fcn" event={"ID":"c747eb50-d833-40d9-8a2f-da94f3145aeb","Type":"ContainerDied","Data":"a1824b2b49211957da2d62fed0ca99d180ebe3b2276d78e6c75c93d58826f9f9"}
Oct 30 22:03:01.879233 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.878870    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-j7fcn" event={"ID":"c747eb50-d833-40d9-8a2f-da94f3145aeb","Type":"ContainerDied","Data":"7ad99b3943909047be3e91c4891995e8e9997c5b411d48be3c8b2eca7c9756a2"}
Oct 30 22:03:01.879233 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.878894    5258 scope.go:122] "RemoveContainer" containerID="a1824b2b49211957da2d62fed0ca99d180ebe3b2276d78e6c75c93d58826f9f9"
Oct 30 22:03:01.888032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.888015    5258 scope.go:122] "RemoveContainer" containerID="a1824b2b49211957da2d62fed0ca99d180ebe3b2276d78e6c75c93d58826f9f9"
Oct 30 22:03:01.888297 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:03:01.888277    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1824b2b49211957da2d62fed0ca99d180ebe3b2276d78e6c75c93d58826f9f9\": container with ID starting with a1824b2b49211957da2d62fed0ca99d180ebe3b2276d78e6c75c93d58826f9f9 not found: ID does not exist" containerID="a1824b2b49211957da2d62fed0ca99d180ebe3b2276d78e6c75c93d58826f9f9"
Oct 30 22:03:01.888334 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:01.888307    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1824b2b49211957da2d62fed0ca99d180ebe3b2276d78e6c75c93d58826f9f9"} err="failed to get container status \"a1824b2b49211957da2d62fed0ca99d180ebe3b2276d78e6c75c93d58826f9f9\": rpc error: code = NotFound desc = could not find container \"a1824b2b49211957da2d62fed0ca99d180ebe3b2276d78e6c75c93d58826f9f9\": container with ID starting with a1824b2b49211957da2d62fed0ca99d180ebe3b2276d78e6c75c93d58826f9f9 not found: ID does not exist"
Oct 30 22:03:02.045535 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:02.045441    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-j7fcn"]
Oct 30 22:03:02.094760 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:02.094725    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-j7fcn"]
Oct 30 22:03:03.384603 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:03.384558    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c747eb50-d833-40d9-8a2f-da94f3145aeb" path="/var/lib/kubelet/pods/c747eb50-d833-40d9-8a2f-da94f3145aeb/volumes"
Oct 30 22:03:03.840243 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:03.840218    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-zfzcp"
Oct 30 22:03:13.159129 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:03:13.159095    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:03:17.981885 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:17.981851    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:21.602326 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:21.602257    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:21.839187 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:21.839150    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:23.778968 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:23.778933    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:24.004016 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:24.003980    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:24.231391 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:24.231337    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:30.467825 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:30.467786    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:03:33.576666 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:33.576629    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:33.797876 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:33.797839    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:34.968687 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:34.968655    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:35.195862 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.195830    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-k6rc5"]
Oct 30 22:03:35.196210 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.196197    5258 cpu_manager.go:414] "containerMap: removing container" podUID="c747eb50-d833-40d9-8a2f-da94f3145aeb" containerName="manager"
Oct 30 22:03:35.196254 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.196211    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c747eb50-d833-40d9-8a2f-da94f3145aeb" containerName="manager"
Oct 30 22:03:35.196299 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.196291    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="c747eb50-d833-40d9-8a2f-da94f3145aeb" containerName="manager"
Oct 30 22:03:35.198171 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.198155    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-k6rc5"
Oct 30 22:03:35.280038 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.279965    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-k6rc5"]
Oct 30 22:03:35.304621 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.304579    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgfqd\" (UniqueName: \"kubernetes.io/projected/7ccc1700-e7be-4364-a680-8d52c7b15a9e-kube-api-access-jgfqd\") pod \"authorino-6f6944bcdd-k6rc5\" (UID: \"7ccc1700-e7be-4364-a680-8d52c7b15a9e\") " pod="kuadrant-system/authorino-6f6944bcdd-k6rc5"
Oct 30 22:03:35.370544 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.370514    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:35.406106 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.406068    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgfqd\" (UniqueName: \"kubernetes.io/projected/7ccc1700-e7be-4364-a680-8d52c7b15a9e-kube-api-access-jgfqd\") pod \"authorino-6f6944bcdd-k6rc5\" (UID: \"7ccc1700-e7be-4364-a680-8d52c7b15a9e\") " pod="kuadrant-system/authorino-6f6944bcdd-k6rc5"
Oct 30 22:03:35.477840 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.477809    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgfqd\" (UniqueName: \"kubernetes.io/projected/7ccc1700-e7be-4364-a680-8d52c7b15a9e-kube-api-access-jgfqd\") pod \"authorino-6f6944bcdd-k6rc5\" (UID: \"7ccc1700-e7be-4364-a680-8d52c7b15a9e\") " pod="kuadrant-system/authorino-6f6944bcdd-k6rc5"
Oct 30 22:03:35.508730 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.508703    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-k6rc5"
Oct 30 22:03:35.583370 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.583042    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-k6rc5"]
Oct 30 22:03:35.604423 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.604024    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6df8b95496-zzhgh"]
Oct 30 22:03:35.607435 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.607412    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6df8b95496-zzhgh"
Oct 30 22:03:35.678055 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.678018    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6df8b95496-zzhgh"]
Oct 30 22:03:35.708342 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.708316    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpnjx\" (UniqueName: \"kubernetes.io/projected/a62755f6-2259-4184-ab96-f064d7632cfd-kube-api-access-zpnjx\") pod \"authorino-6df8b95496-zzhgh\" (UID: \"a62755f6-2259-4184-ab96-f064d7632cfd\") " pod="kuadrant-system/authorino-6df8b95496-zzhgh"
Oct 30 22:03:35.809469 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.809437    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpnjx\" (UniqueName: \"kubernetes.io/projected/a62755f6-2259-4184-ab96-f064d7632cfd-kube-api-access-zpnjx\") pod \"authorino-6df8b95496-zzhgh\" (UID: \"a62755f6-2259-4184-ab96-f064d7632cfd\") " pod="kuadrant-system/authorino-6df8b95496-zzhgh"
Oct 30 22:03:35.878205 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.878140    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpnjx\" (UniqueName: \"kubernetes.io/projected/a62755f6-2259-4184-ab96-f064d7632cfd-kube-api-access-zpnjx\") pod \"authorino-6df8b95496-zzhgh\" (UID: \"a62755f6-2259-4184-ab96-f064d7632cfd\") " pod="kuadrant-system/authorino-6df8b95496-zzhgh"
Oct 30 22:03:35.902567 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.902540    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-k6rc5"]
Oct 30 22:03:35.905214 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:03:35.905187    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ccc1700_e7be_4364_a680_8d52c7b15a9e.slice/crio-7a86b9c5edbe3f003625b107fa008ba672ac681b8890f58a02fec28e70b80e78 WatchSource:0}: Error finding container 7a86b9c5edbe3f003625b107fa008ba672ac681b8890f58a02fec28e70b80e78: Status 404 returned error can't find the container with id 7a86b9c5edbe3f003625b107fa008ba672ac681b8890f58a02fec28e70b80e78
Oct 30 22:03:35.919545 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:35.919521    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6df8b95496-zzhgh"
Oct 30 22:03:36.041741 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.041702    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6df8b95496-zzhgh"]
Oct 30 22:03:36.051204 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.051171    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-k6rc5" event={"ID":"7ccc1700-e7be-4364-a680-8d52c7b15a9e","Type":"ContainerStarted","Data":"7a86b9c5edbe3f003625b107fa008ba672ac681b8890f58a02fec28e70b80e78"}
Oct 30 22:03:36.077067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.077031    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59fd5995d6-xwxfc"]
Oct 30 22:03:36.082053 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.082024    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59fd5995d6-xwxfc"
Oct 30 22:03:36.112714 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.112690    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/66f2642b-c4d8-4422-a2a3-038f8b6d7473-tls-cert\") pod \"authorino-59fd5995d6-xwxfc\" (UID: \"66f2642b-c4d8-4422-a2a3-038f8b6d7473\") " pod="kuadrant-system/authorino-59fd5995d6-xwxfc"
Oct 30 22:03:36.112839 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.112764    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t4vb\" (UniqueName: \"kubernetes.io/projected/66f2642b-c4d8-4422-a2a3-038f8b6d7473-kube-api-access-9t4vb\") pod \"authorino-59fd5995d6-xwxfc\" (UID: \"66f2642b-c4d8-4422-a2a3-038f8b6d7473\") " pod="kuadrant-system/authorino-59fd5995d6-xwxfc"
Oct 30 22:03:36.138910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.138850    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 30 22:03:36.139362 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.139334    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59fd5995d6-xwxfc"]
Oct 30 22:03:36.213527 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.213497    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t4vb\" (UniqueName: \"kubernetes.io/projected/66f2642b-c4d8-4422-a2a3-038f8b6d7473-kube-api-access-9t4vb\") pod \"authorino-59fd5995d6-xwxfc\" (UID: \"66f2642b-c4d8-4422-a2a3-038f8b6d7473\") " pod="kuadrant-system/authorino-59fd5995d6-xwxfc"
Oct 30 22:03:36.213702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.213539    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/66f2642b-c4d8-4422-a2a3-038f8b6d7473-tls-cert\") pod \"authorino-59fd5995d6-xwxfc\" (UID: \"66f2642b-c4d8-4422-a2a3-038f8b6d7473\") " pod="kuadrant-system/authorino-59fd5995d6-xwxfc"
Oct 30 22:03:36.216001 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.215971    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/66f2642b-c4d8-4422-a2a3-038f8b6d7473-tls-cert\") pod \"authorino-59fd5995d6-xwxfc\" (UID: \"66f2642b-c4d8-4422-a2a3-038f8b6d7473\") " pod="kuadrant-system/authorino-59fd5995d6-xwxfc"
Oct 30 22:03:36.276076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.276051    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t4vb\" (UniqueName: \"kubernetes.io/projected/66f2642b-c4d8-4422-a2a3-038f8b6d7473-kube-api-access-9t4vb\") pod \"authorino-59fd5995d6-xwxfc\" (UID: \"66f2642b-c4d8-4422-a2a3-038f8b6d7473\") " pod="kuadrant-system/authorino-59fd5995d6-xwxfc"
Oct 30 22:03:36.308075 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.308051    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6df8b95496-zzhgh"]
Oct 30 22:03:36.310898 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:03:36.310875    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda62755f6_2259_4184_ab96_f064d7632cfd.slice/crio-aeb092ea87f64ade15e23ae00559f519855aa7770aeb6a6879bcaeaae2c12fde WatchSource:0}: Error finding container aeb092ea87f64ade15e23ae00559f519855aa7770aeb6a6879bcaeaae2c12fde: Status 404 returned error can't find the container with id aeb092ea87f64ade15e23ae00559f519855aa7770aeb6a6879bcaeaae2c12fde
Oct 30 22:03:36.394552 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.394486    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59fd5995d6-xwxfc"
Oct 30 22:03:36.768379 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:36.768355    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59fd5995d6-xwxfc"]
Oct 30 22:03:36.770490 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:03:36.770451    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66f2642b_c4d8_4422_a2a3_038f8b6d7473.slice/crio-89ee393a51de115a3eeeb569a277eaae126f46d5f5a34e78e6ba78c17e88ecec WatchSource:0}: Error finding container 89ee393a51de115a3eeeb569a277eaae126f46d5f5a34e78e6ba78c17e88ecec: Status 404 returned error can't find the container with id 89ee393a51de115a3eeeb569a277eaae126f46d5f5a34e78e6ba78c17e88ecec
Oct 30 22:03:37.058793 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:37.058755    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6df8b95496-zzhgh" event={"ID":"a62755f6-2259-4184-ab96-f064d7632cfd","Type":"ContainerStarted","Data":"aeb092ea87f64ade15e23ae00559f519855aa7770aeb6a6879bcaeaae2c12fde"}
Oct 30 22:03:37.060112 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:37.060084    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59fd5995d6-xwxfc" event={"ID":"66f2642b-c4d8-4422-a2a3-038f8b6d7473","Type":"ContainerStarted","Data":"89ee393a51de115a3eeeb569a277eaae126f46d5f5a34e78e6ba78c17e88ecec"}
Oct 30 22:03:38.068272 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:38.068235    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6df8b95496-zzhgh" event={"ID":"a62755f6-2259-4184-ab96-f064d7632cfd","Type":"ContainerStarted","Data":"d18e55646715f86ad910c3113d9f23e9bfe9e1ec6ee902b56aed6b1074fb1e6e"}
Oct 30 22:03:38.068272 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:38.068259    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6df8b95496-zzhgh" podUID="a62755f6-2259-4184-ab96-f064d7632cfd" containerName="authorino" containerID="cri-o://d18e55646715f86ad910c3113d9f23e9bfe9e1ec6ee902b56aed6b1074fb1e6e" gracePeriod=30
Oct 30 22:03:38.069966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:38.069944    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-k6rc5" event={"ID":"7ccc1700-e7be-4364-a680-8d52c7b15a9e","Type":"ContainerStarted","Data":"a7317e435951f897111057b84e6d15562e0512a7ae666f96475cda58058821ca"}
Oct 30 22:03:38.070098 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:38.070042    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-k6rc5" podUID="7ccc1700-e7be-4364-a680-8d52c7b15a9e" containerName="authorino" containerID="cri-o://a7317e435951f897111057b84e6d15562e0512a7ae666f96475cda58058821ca" gracePeriod=30
Oct 30 22:03:38.186384 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:38.186346    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6df8b95496-zzhgh" podStartSLOduration=1.857269247 podStartE2EDuration="3.186333002s" totalImagesPullingTime="1.329063755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:38.183784833 +0000 UTC m=+532.914641992" watchObservedRunningTime="2026-10-30 22:03:38.186333002 +0000 UTC m=+532.917190144"
Oct 30 22:03:38.301527 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:38.301196    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-k6rc5" podStartSLOduration=1.753021876 podStartE2EDuration="3.301177618s" totalImagesPullingTime="1.548155742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:38.299364219 +0000 UTC m=+533.030221363" watchObservedRunningTime="2026-10-30 22:03:38.301177618 +0000 UTC m=+533.032034763"
Oct 30 22:03:38.340552 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:38.340526    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6df8b95496-zzhgh"
Oct 30 22:03:38.378659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:38.378635    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-k6rc5"
Oct 30 22:03:38.433704 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:38.433674    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a62755f6-2259-4184-ab96-f064d7632cfd-kube-api-access-zpnjx\" (UniqueName: \"kubernetes.io/projected/a62755f6-2259-4184-ab96-f064d7632cfd-kube-api-access-zpnjx\") pod \"a62755f6-2259-4184-ab96-f064d7632cfd\" (UID: \"a62755f6-2259-4184-ab96-f064d7632cfd\") "
Oct 30 22:03:38.433878 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:38.433820    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7ccc1700-e7be-4364-a680-8d52c7b15a9e-kube-api-access-jgfqd\" (UniqueName: \"kubernetes.io/projected/7ccc1700-e7be-4364-a680-8d52c7b15a9e-kube-api-access-jgfqd\") pod \"7ccc1700-e7be-4364-a680-8d52c7b15a9e\" (UID: \"7ccc1700-e7be-4364-a680-8d52c7b15a9e\") "
Oct 30 22:03:38.435956 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:38.435925    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ccc1700-e7be-4364-a680-8d52c7b15a9e-kube-api-access-jgfqd" pod "7ccc1700-e7be-4364-a680-8d52c7b15a9e" (UID: "7ccc1700-e7be-4364-a680-8d52c7b15a9e"). InnerVolumeSpecName "kube-api-access-jgfqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:03:38.436168 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:38.436150    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a62755f6-2259-4184-ab96-f064d7632cfd-kube-api-access-zpnjx" pod "a62755f6-2259-4184-ab96-f064d7632cfd" (UID: "a62755f6-2259-4184-ab96-f064d7632cfd"). InnerVolumeSpecName "kube-api-access-zpnjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:03:38.535110 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:38.535073    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgfqd\" (UniqueName: \"kubernetes.io/projected/7ccc1700-e7be-4364-a680-8d52c7b15a9e-kube-api-access-jgfqd\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:38.535110 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:38.535104    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpnjx\" (UniqueName: \"kubernetes.io/projected/a62755f6-2259-4184-ab96-f064d7632cfd-kube-api-access-zpnjx\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:39.077602 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.077554    5258 generic.go:356] "Generic (PLEG): container finished" podID="7ccc1700-e7be-4364-a680-8d52c7b15a9e" containerID="a7317e435951f897111057b84e6d15562e0512a7ae666f96475cda58058821ca" exitCode=0
Oct 30 22:03:39.078093 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.077629    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-k6rc5" event={"ID":"7ccc1700-e7be-4364-a680-8d52c7b15a9e","Type":"ContainerDied","Data":"a7317e435951f897111057b84e6d15562e0512a7ae666f96475cda58058821ca"}
Oct 30 22:03:39.078093 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.077675    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-k6rc5" event={"ID":"7ccc1700-e7be-4364-a680-8d52c7b15a9e","Type":"ContainerDied","Data":"7a86b9c5edbe3f003625b107fa008ba672ac681b8890f58a02fec28e70b80e78"}
Oct 30 22:03:39.078093 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.077699    5258 scope.go:122] "RemoveContainer" containerID="a7317e435951f897111057b84e6d15562e0512a7ae666f96475cda58058821ca"
Oct 30 22:03:39.078093 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.077637    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-k6rc5"
Oct 30 22:03:39.079666 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.079634    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59fd5995d6-xwxfc" event={"ID":"66f2642b-c4d8-4422-a2a3-038f8b6d7473","Type":"ContainerStarted","Data":"06f062655384d6dc123fe4e9ff50cf8aee6e4ed32aa1495a5030fa43799a946a"}
Oct 30 22:03:39.081393 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.081369    5258 generic.go:356] "Generic (PLEG): container finished" podID="a62755f6-2259-4184-ab96-f064d7632cfd" containerID="d18e55646715f86ad910c3113d9f23e9bfe9e1ec6ee902b56aed6b1074fb1e6e" exitCode=0
Oct 30 22:03:39.081505 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.081422    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6df8b95496-zzhgh"
Oct 30 22:03:39.081505 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.081478    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6df8b95496-zzhgh" event={"ID":"a62755f6-2259-4184-ab96-f064d7632cfd","Type":"ContainerDied","Data":"d18e55646715f86ad910c3113d9f23e9bfe9e1ec6ee902b56aed6b1074fb1e6e"}
Oct 30 22:03:39.081598 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.081518    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6df8b95496-zzhgh" event={"ID":"a62755f6-2259-4184-ab96-f064d7632cfd","Type":"ContainerDied","Data":"aeb092ea87f64ade15e23ae00559f519855aa7770aeb6a6879bcaeaae2c12fde"}
Oct 30 22:03:39.097491 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.096212    5258 scope.go:122] "RemoveContainer" containerID="a7317e435951f897111057b84e6d15562e0512a7ae666f96475cda58058821ca"
Oct 30 22:03:39.097491 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:03:39.096750    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7317e435951f897111057b84e6d15562e0512a7ae666f96475cda58058821ca\": container with ID starting with a7317e435951f897111057b84e6d15562e0512a7ae666f96475cda58058821ca not found: ID does not exist" containerID="a7317e435951f897111057b84e6d15562e0512a7ae666f96475cda58058821ca"
Oct 30 22:03:39.097491 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.096790    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7317e435951f897111057b84e6d15562e0512a7ae666f96475cda58058821ca"} err="failed to get container status \"a7317e435951f897111057b84e6d15562e0512a7ae666f96475cda58058821ca\": rpc error: code = NotFound desc = could not find container \"a7317e435951f897111057b84e6d15562e0512a7ae666f96475cda58058821ca\": container with ID starting with a7317e435951f897111057b84e6d15562e0512a7ae666f96475cda58058821ca not found: ID does not exist"
Oct 30 22:03:39.097491 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.096814    5258 scope.go:122] "RemoveContainer" containerID="d18e55646715f86ad910c3113d9f23e9bfe9e1ec6ee902b56aed6b1074fb1e6e"
Oct 30 22:03:39.123038 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.123008    5258 scope.go:122] "RemoveContainer" containerID="d18e55646715f86ad910c3113d9f23e9bfe9e1ec6ee902b56aed6b1074fb1e6e"
Oct 30 22:03:39.123549 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:03:39.123519    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d18e55646715f86ad910c3113d9f23e9bfe9e1ec6ee902b56aed6b1074fb1e6e\": container with ID starting with d18e55646715f86ad910c3113d9f23e9bfe9e1ec6ee902b56aed6b1074fb1e6e not found: ID does not exist" containerID="d18e55646715f86ad910c3113d9f23e9bfe9e1ec6ee902b56aed6b1074fb1e6e"
Oct 30 22:03:39.123644 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.123563    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d18e55646715f86ad910c3113d9f23e9bfe9e1ec6ee902b56aed6b1074fb1e6e"} err="failed to get container status \"d18e55646715f86ad910c3113d9f23e9bfe9e1ec6ee902b56aed6b1074fb1e6e\": rpc error: code = NotFound desc = could not find container \"d18e55646715f86ad910c3113d9f23e9bfe9e1ec6ee902b56aed6b1074fb1e6e\": container with ID starting with d18e55646715f86ad910c3113d9f23e9bfe9e1ec6ee902b56aed6b1074fb1e6e not found: ID does not exist"
Oct 30 22:03:39.246551 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.246515    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6df8b95496-zzhgh"]
Oct 30 22:03:39.253346 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.253314    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6df8b95496-zzhgh"]
Oct 30 22:03:39.366948 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.366852    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-59fd5995d6-xwxfc" podStartSLOduration=1.916150298 podStartE2EDuration="3.366836075s" totalImagesPullingTime="1.450685777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:03:39.366247195 +0000 UTC m=+534.097104340" watchObservedRunningTime="2026-10-30 22:03:39.366836075 +0000 UTC m=+534.097693218"
Oct 30 22:03:39.383553 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.383514    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a62755f6-2259-4184-ab96-f064d7632cfd" path="/var/lib/kubelet/pods/a62755f6-2259-4184-ab96-f064d7632cfd/volumes"
Oct 30 22:03:39.401350 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.401311    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-p57ht"]
Oct 30 22:03:39.401820 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.401775    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-p57ht" podUID="3607842c-3ddd-4f53-9c48-c5af16d872b8" containerName="authorino" containerID="cri-o://68d5d07b2c42307e317341eb5c48f76b2d6a89900f57fd5d1f2369a3d52a68f8" gracePeriod=30
Oct 30 22:03:39.493563 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.493531    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-k6rc5"]
Oct 30 22:03:39.500966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.500939    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-k6rc5"]
Oct 30 22:03:39.674928 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.674872    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-p57ht"
Oct 30 22:03:39.747436 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.747407    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3607842c-3ddd-4f53-9c48-c5af16d872b8-kube-api-access-98krc\" (UniqueName: \"kubernetes.io/projected/3607842c-3ddd-4f53-9c48-c5af16d872b8-kube-api-access-98krc\") pod \"3607842c-3ddd-4f53-9c48-c5af16d872b8\" (UID: \"3607842c-3ddd-4f53-9c48-c5af16d872b8\") "
Oct 30 22:03:39.749349 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.749324    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3607842c-3ddd-4f53-9c48-c5af16d872b8-kube-api-access-98krc" pod "3607842c-3ddd-4f53-9c48-c5af16d872b8" (UID: "3607842c-3ddd-4f53-9c48-c5af16d872b8"). InnerVolumeSpecName "kube-api-access-98krc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:03:39.848696 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:39.848666    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98krc\" (UniqueName: \"kubernetes.io/projected/3607842c-3ddd-4f53-9c48-c5af16d872b8-kube-api-access-98krc\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:40.089184 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.089153    5258 generic.go:356] "Generic (PLEG): container finished" podID="d804a5f8-76b1-4ac5-bef4-ab73965299f6" containerID="c1829ec3188900fc92158f5a78c49d224dd88fa91fd698c365c49b8fea2cb886" exitCode=0
Oct 30 22:03:40.089606 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.089221    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4" event={"ID":"d804a5f8-76b1-4ac5-bef4-ab73965299f6","Type":"ContainerDied","Data":"c1829ec3188900fc92158f5a78c49d224dd88fa91fd698c365c49b8fea2cb886"}
Oct 30 22:03:40.089681 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.089583    5258 scope.go:122] "RemoveContainer" containerID="c1829ec3188900fc92158f5a78c49d224dd88fa91fd698c365c49b8fea2cb886"
Oct 30 22:03:40.090747 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.090716    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:03:40.090843 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.090800    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:03:40.090887 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.090843    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:03:40.091442 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.091417    5258 generic.go:356] "Generic (PLEG): container finished" podID="3607842c-3ddd-4f53-9c48-c5af16d872b8" containerID="68d5d07b2c42307e317341eb5c48f76b2d6a89900f57fd5d1f2369a3d52a68f8" exitCode=0
Oct 30 22:03:40.091514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.091464    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-p57ht"
Oct 30 22:03:40.091514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.091482    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-p57ht" event={"ID":"3607842c-3ddd-4f53-9c48-c5af16d872b8","Type":"ContainerDied","Data":"68d5d07b2c42307e317341eb5c48f76b2d6a89900f57fd5d1f2369a3d52a68f8"}
Oct 30 22:03:40.091649 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.091520    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-p57ht" event={"ID":"3607842c-3ddd-4f53-9c48-c5af16d872b8","Type":"ContainerDied","Data":"7f5a7a5dce9cc35e322ae799abf42c4e465f880b00e074be4cd39b607891b4a2"}
Oct 30 22:03:40.091649 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.091542    5258 scope.go:122] "RemoveContainer" containerID="68d5d07b2c42307e317341eb5c48f76b2d6a89900f57fd5d1f2369a3d52a68f8"
Oct 30 22:03:40.100920 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.100903    5258 scope.go:122] "RemoveContainer" containerID="68d5d07b2c42307e317341eb5c48f76b2d6a89900f57fd5d1f2369a3d52a68f8"
Oct 30 22:03:40.101178 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:03:40.101157    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68d5d07b2c42307e317341eb5c48f76b2d6a89900f57fd5d1f2369a3d52a68f8\": container with ID starting with 68d5d07b2c42307e317341eb5c48f76b2d6a89900f57fd5d1f2369a3d52a68f8 not found: ID does not exist" containerID="68d5d07b2c42307e317341eb5c48f76b2d6a89900f57fd5d1f2369a3d52a68f8"
Oct 30 22:03:40.101230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.101185    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68d5d07b2c42307e317341eb5c48f76b2d6a89900f57fd5d1f2369a3d52a68f8"} err="failed to get container status \"68d5d07b2c42307e317341eb5c48f76b2d6a89900f57fd5d1f2369a3d52a68f8\": rpc error: code = NotFound desc = could not find container \"68d5d07b2c42307e317341eb5c48f76b2d6a89900f57fd5d1f2369a3d52a68f8\": container with ID starting with 68d5d07b2c42307e317341eb5c48f76b2d6a89900f57fd5d1f2369a3d52a68f8 not found: ID does not exist"
Oct 30 22:03:40.331001 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.330966    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-p57ht"]
Oct 30 22:03:40.334232 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.334207    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-p57ht"]
Oct 30 22:03:40.774613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:40.773696    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 22:03:41.098538 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:41.098502    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4" event={"ID":"d804a5f8-76b1-4ac5-bef4-ab73965299f6","Type":"ContainerStarted","Data":"cb6e6cd355beb972adb6d9ae1c81ce3bcb84d284e1dc9b3cecedddcad7b7dcac"}
Oct 30 22:03:41.382210 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:41.382133    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3607842c-3ddd-4f53-9c48-c5af16d872b8" path="/var/lib/kubelet/pods/3607842c-3ddd-4f53-9c48-c5af16d872b8/volumes"
Oct 30 22:03:41.382479 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:41.382466    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7ccc1700-e7be-4364-a680-8d52c7b15a9e" path="/var/lib/kubelet/pods/7ccc1700-e7be-4364-a680-8d52c7b15a9e/volumes"
Oct 30 22:03:41.998051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:41.998013    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 22:03:41.999055 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:41.999028    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-x6hg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Oct 30 22:03:41.999167 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:41.999080    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4" podUID="d804a5f8-76b1-4ac5-bef4-ab73965299f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Oct 30 22:03:42.998091 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:42.998051    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-x6hg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Oct 30 22:03:42.998490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:42.998117    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4" podUID="d804a5f8-76b1-4ac5-bef4-ab73965299f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Oct 30 22:03:43.185519 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:03:43.185480    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:03:43.998109 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:43.998068    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-x6hg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Oct 30 22:03:43.998519 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:43.998131    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4" podUID="d804a5f8-76b1-4ac5-bef4-ab73965299f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Oct 30 22:03:44.997648 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:44.997611    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-x6hg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Oct 30 22:03:44.997829 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:44.997668    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4" podUID="d804a5f8-76b1-4ac5-bef4-ab73965299f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Oct 30 22:03:45.998458 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:45.998422    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-x6hg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Oct 30 22:03:45.998891 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:45.998484    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4" podUID="d804a5f8-76b1-4ac5-bef4-ab73965299f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Oct 30 22:03:47.002565 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:47.002532    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 22:03:47.002946 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:47.002830    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 22:03:47.003653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:47.003627    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4"
Oct 30 22:03:50.897753 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:50.897722    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:54.731221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:54.731184    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:55.006650 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:03:55.006546    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:05.875024 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:05.874944    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:08.693812 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:08.693778    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:13.160700 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:04:13.160665    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:04:18.343689 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:18.343658    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:39.611088 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:39.611052    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:39.916514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:39.916430    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:43.159347 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:04:43.159313    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:04:45.422423 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:45.422396    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:04:45.422423 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:45.422413    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:04:51.599266 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:51.599231    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:51.876757 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:51.876665    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:54.978567 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:54.978539    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:56.030108 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:56.030066    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:57.055718 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.055667    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"]
Oct 30 22:04:57.056126 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.056081    5258 cpu_manager.go:414] "containerMap: removing container" podUID="7ccc1700-e7be-4364-a680-8d52c7b15a9e" containerName="authorino"
Oct 30 22:04:57.056126 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.056093    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7ccc1700-e7be-4364-a680-8d52c7b15a9e" containerName="authorino"
Oct 30 22:04:57.056126 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.056102    5258 cpu_manager.go:414] "containerMap: removing container" podUID="a62755f6-2259-4184-ab96-f064d7632cfd" containerName="authorino"
Oct 30 22:04:57.056126 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.056107    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a62755f6-2259-4184-ab96-f064d7632cfd" containerName="authorino"
Oct 30 22:04:57.056126 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.056117    5258 cpu_manager.go:414] "containerMap: removing container" podUID="3607842c-3ddd-4f53-9c48-c5af16d872b8" containerName="authorino"
Oct 30 22:04:57.056126 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.056123    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3607842c-3ddd-4f53-9c48-c5af16d872b8" containerName="authorino"
Oct 30 22:04:57.056334 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.056194    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="7ccc1700-e7be-4364-a680-8d52c7b15a9e" containerName="authorino"
Oct 30 22:04:57.056334 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.056201    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="a62755f6-2259-4184-ab96-f064d7632cfd" containerName="authorino"
Oct 30 22:04:57.056334 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.056208    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="3607842c-3ddd-4f53-9c48-c5af16d872b8" containerName="authorino"
Oct 30 22:04:57.058189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.058170    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.110818 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.110787    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f24980-650b-47e6-9d86-2cf74f4f105d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.110966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.110827    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7f24980-650b-47e6-9d86-2cf74f4f105d-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.110966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.110862    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvcvl\" (UniqueName: \"kubernetes.io/projected/a7f24980-650b-47e6-9d86-2cf74f4f105d-kube-api-access-xvcvl\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.110966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.110955    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7f24980-650b-47e6-9d86-2cf74f4f105d-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.111154 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.110981    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7f24980-650b-47e6-9d86-2cf74f4f105d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.111154 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.111007    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7f24980-650b-47e6-9d86-2cf74f4f105d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.161673 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.161645    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Oct 30 22:04:57.161850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.161690    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rdd77\""
Oct 30 22:04:57.161850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.161721    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 30 22:04:57.161850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.161732    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 30 22:04:57.167555 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.167528    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"]
Oct 30 22:04:57.211679 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.211651    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f24980-650b-47e6-9d86-2cf74f4f105d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.211822 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.211696    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7f24980-650b-47e6-9d86-2cf74f4f105d-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.211822 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.211730    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvcvl\" (UniqueName: \"kubernetes.io/projected/a7f24980-650b-47e6-9d86-2cf74f4f105d-kube-api-access-xvcvl\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.211822 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.211765    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7f24980-650b-47e6-9d86-2cf74f4f105d-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.211822 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.211792    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7f24980-650b-47e6-9d86-2cf74f4f105d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.211993 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.211836    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7f24980-650b-47e6-9d86-2cf74f4f105d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.212189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.212160    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7f24980-650b-47e6-9d86-2cf74f4f105d-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.212275 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.212225    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7f24980-650b-47e6-9d86-2cf74f4f105d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.212275 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.212255    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7f24980-650b-47e6-9d86-2cf74f4f105d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.214906 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.214879    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7f24980-650b-47e6-9d86-2cf74f4f105d-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.215786 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.215764    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f24980-650b-47e6-9d86-2cf74f4f105d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.274721 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.274692    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvcvl\" (UniqueName: \"kubernetes.io/projected/a7f24980-650b-47e6-9d86-2cf74f4f105d-kube-api-access-xvcvl\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9\" (UID: \"a7f24980-650b-47e6-9d86-2cf74f4f105d\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.310509 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.310479    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:57.369156 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.369130    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:04:57.748371 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.748308    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"]
Oct 30 22:04:57.750704 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:04:57.750677    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f24980_650b_47e6_9d86_2cf74f4f105d.slice/crio-66d197e461007e411cdd708bdfc766286d1b51a96206b862395ca3440005f6e8 WatchSource:0}: Error finding container 66d197e461007e411cdd708bdfc766286d1b51a96206b862395ca3440005f6e8: Status 404 returned error can't find the container with id 66d197e461007e411cdd708bdfc766286d1b51a96206b862395ca3440005f6e8
Oct 30 22:04:57.752125 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:57.752110    5258 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:04:58.496486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:58.496448    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9" event={"ID":"a7f24980-650b-47e6-9d86-2cf74f4f105d","Type":"ContainerStarted","Data":"66d197e461007e411cdd708bdfc766286d1b51a96206b862395ca3440005f6e8"}
Oct 30 22:04:59.502604 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:59.502557    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9" event={"ID":"a7f24980-650b-47e6-9d86-2cf74f4f105d","Type":"ContainerStarted","Data":"687249df65dade55fc469a6aecc3372b8dc05436d5f74ac915ce5928cf7e4b37"}
Oct 30 22:04:59.623290 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:04:59.623243    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9" podStartSLOduration=1.116180705 podStartE2EDuration="2.623230941s" totalImagesPullingTime="1.507050236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:59.621846522 +0000 UTC m=+614.352703666" watchObservedRunningTime="2026-10-30 22:04:59.623230941 +0000 UTC m=+614.354088084"
Oct 30 22:05:00.369781 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:00.369747    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:05:00.698649 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:00.698546    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:05:01.695496 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:01.695462    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:05.590499 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.590465    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"]
Oct 30 22:05:05.594115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.594096    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.685191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.685152    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.685191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.685195    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.685435 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.685307    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kfbq\" (UniqueName: \"kubernetes.io/projected/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-kube-api-access-5kfbq\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.685435 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.685353    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.685435 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.685376    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.685561 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.685526    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.696150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.696120    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Oct 30 22:05:05.698203 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.698185    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"]
Oct 30 22:05:05.786965 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.786934    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.786965 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.786968    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.787218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.787011    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.787218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.787082    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.787218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.787106    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.787218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.787131    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kfbq\" (UniqueName: \"kubernetes.io/projected/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-kube-api-access-5kfbq\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.787477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.787453    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.787573 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.787550    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.787654 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.787618    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.789194 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.789172    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.789564 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.789545    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.826434 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.826413    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:05.853872 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.853816    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kfbq\" (UniqueName: \"kubernetes.io/projected/0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f-kube-api-access-5kfbq\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k\" (UID: \"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:05.904749 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:05.904724    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:06.319790 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:06.319366    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"]
Oct 30 22:05:06.319790 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:05:06.319542    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f21c3e9_0a4e_4cef_8cdc_9546bd9cd97f.slice/crio-5c1de6ae5e091fa1381594a4674a7b3288932aaf48a04cf162f7499252d90f8d WatchSource:0}: Error finding container 5c1de6ae5e091fa1381594a4674a7b3288932aaf48a04cf162f7499252d90f8d: Status 404 returned error can't find the container with id 5c1de6ae5e091fa1381594a4674a7b3288932aaf48a04cf162f7499252d90f8d
Oct 30 22:05:06.540488 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:06.540447    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" event={"ID":"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f","Type":"ContainerStarted","Data":"5c1de6ae5e091fa1381594a4674a7b3288932aaf48a04cf162f7499252d90f8d"}
Oct 30 22:05:07.370316 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:07.370282    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:05:07.384079 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:07.384057    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:05:07.547180 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:07.547143    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" event={"ID":"0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f","Type":"ContainerStarted","Data":"fc621853836f89d535bbb5d682a220b1b03be3c63632a7716caa217a73229a35"}
Oct 30 22:05:07.563523 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:07.563495    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9"
Oct 30 22:05:07.666923 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:07.666834    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podStartSLOduration=2.090168547 podStartE2EDuration="2.666819928s" totalImagesPullingTime="576.651381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:07.665899959 +0000 UTC m=+622.396757102" watchObservedRunningTime="2026-10-30 22:05:07.666819928 +0000 UTC m=+622.397677070"
Oct 30 22:05:07.753678 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:07.753645    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:07.905359 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:07.905330    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:09.298543 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:09.298506    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:05:11.990568 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:11.990528    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:13.158781 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:05:13.158749    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:05:15.639608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.636846    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"]
Oct 30 22:05:15.641488 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.641461    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.740916 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.740877    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Oct 30 22:05:15.751267 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.751231    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"]
Oct 30 22:05:15.779125 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.779025    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b034e42-8bd5-4442-a7e8-04185f498f2a-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.779125 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.779068    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b034e42-8bd5-4442-a7e8-04185f498f2a-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.779125 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.779094    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hxtn\" (UniqueName: \"kubernetes.io/projected/2b034e42-8bd5-4442-a7e8-04185f498f2a-kube-api-access-5hxtn\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.779434 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.779337    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b034e42-8bd5-4442-a7e8-04185f498f2a-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.779495 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.779431    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b034e42-8bd5-4442-a7e8-04185f498f2a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.779495 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.779461    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b034e42-8bd5-4442-a7e8-04185f498f2a-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.867229 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.867184    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:15.880230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.880208    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b034e42-8bd5-4442-a7e8-04185f498f2a-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.880348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.880248    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b034e42-8bd5-4442-a7e8-04185f498f2a-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.880348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.880272    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hxtn\" (UniqueName: \"kubernetes.io/projected/2b034e42-8bd5-4442-a7e8-04185f498f2a-kube-api-access-5hxtn\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.880348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.880317    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b034e42-8bd5-4442-a7e8-04185f498f2a-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.880348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.880343    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b034e42-8bd5-4442-a7e8-04185f498f2a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.880560 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.880365    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b034e42-8bd5-4442-a7e8-04185f498f2a-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.880806 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.880780    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b034e42-8bd5-4442-a7e8-04185f498f2a-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.880936 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.880829    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b034e42-8bd5-4442-a7e8-04185f498f2a-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.880936 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.880881    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b034e42-8bd5-4442-a7e8-04185f498f2a-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.882927 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.882905    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b034e42-8bd5-4442-a7e8-04185f498f2a-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.883235 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.883214    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b034e42-8bd5-4442-a7e8-04185f498f2a-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.905142 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.905072    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:15.918176 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.918153    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:15.946252 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.946217    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hxtn\" (UniqueName: \"kubernetes.io/projected/2b034e42-8bd5-4442-a7e8-04185f498f2a-kube-api-access-5hxtn\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-dzjzr\" (UID: \"2b034e42-8bd5-4442-a7e8-04185f498f2a\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:15.957079 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:15.957050    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:16.351616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:16.350180    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"]
Oct 30 22:05:16.600946 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:16.600853    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr" event={"ID":"2b034e42-8bd5-4442-a7e8-04185f498f2a","Type":"ContainerStarted","Data":"4c81df21e88c0c7bcb254f651e99f0f78ed95ad4fdf176a6935842a086da7fa6"}
Oct 30 22:05:16.616862 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:16.616832    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:05:17.608287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:17.608247    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr" event={"ID":"2b034e42-8bd5-4442-a7e8-04185f498f2a","Type":"ContainerStarted","Data":"74c96d5fb1e92af6ba2a311c1a10d6e4d183687c1c6e4e40cedb88aa90e23e83"}
Oct 30 22:05:17.727091 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:17.727034    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr" podStartSLOduration=2.136473596 podStartE2EDuration="2.727016493s" totalImagesPullingTime="590.542897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:17.726579861 +0000 UTC m=+632.457437005" watchObservedRunningTime="2026-10-30 22:05:17.727016493 +0000 UTC m=+632.457873638"
Oct 30 22:05:17.957962 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:17.957889    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:18.714966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:18.714932    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:19.048489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.048416    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"]
Oct 30 22:05:19.051948 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.051926    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.108795 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.108757    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.108994 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.108926    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.109071 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.109044    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.109123 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.109080    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.109123 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.109105    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.109289 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.109171    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf4xc\" (UniqueName: \"kubernetes.io/projected/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-kube-api-access-rf4xc\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.151091 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.151061    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Oct 30 22:05:19.155734 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.155708    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"]
Oct 30 22:05:19.209839 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.209808    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.210009 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.209928    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.210009 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.209969    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.210009 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.209995    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.210200 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.210116    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf4xc\" (UniqueName: \"kubernetes.io/projected/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-kube-api-access-rf4xc\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.210200 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.210191    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.210305 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.210270    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.210362 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.210346    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.210524 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.210504    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.212772 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.212749    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.213046 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.213026    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.216787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.216761    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:19.272713 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.272693    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf4xc\" (UniqueName: \"kubernetes.io/projected/3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a-kube-api-access-rf4xc\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-jdp6j\" (UID: \"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.364629 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.364569    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:19.528394 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.528357    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:19.753872 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:19.753843    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"]
Oct 30 22:05:19.756478 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:05:19.756453    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a3a3ab7_f8a6_4d58_a199_ae4c3e4b844a.slice/crio-71e6420f29e41fcc35a931112e6beb90381800438d45033eb3143ae4717f087e WatchSource:0}: Error finding container 71e6420f29e41fcc35a931112e6beb90381800438d45033eb3143ae4717f087e: Status 404 returned error can't find the container with id 71e6420f29e41fcc35a931112e6beb90381800438d45033eb3143ae4717f087e
Oct 30 22:05:20.625985 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:20.625905    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j" event={"ID":"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a","Type":"ContainerStarted","Data":"39aac7b4098d328f2556d15b0fcd923a9a624954d9bd80d21f4c069b9024289e"}
Oct 30 22:05:20.625985 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:20.625965    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j" event={"ID":"3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a","Type":"ContainerStarted","Data":"71e6420f29e41fcc35a931112e6beb90381800438d45033eb3143ae4717f087e"}
Oct 30 22:05:20.746440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:20.746383    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j" podStartSLOduration=1.159769594 podStartE2EDuration="1.746364913s" totalImagesPullingTime="586.595319ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:20.744374965 +0000 UTC m=+635.475232098" watchObservedRunningTime="2026-10-30 22:05:20.746364913 +0000 UTC m=+635.477222052"
Oct 30 22:05:21.365217 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:21.365182    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:23.081268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:23.081222    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:05:24.313469 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.313423    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"]
Oct 30 22:05:24.317938 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.317911    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.357414 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.357374    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc19019e-af7f-43bc-8de8-670e7ef903f4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.357635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.357428    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc19019e-af7f-43bc-8de8-670e7ef903f4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.357635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.357466    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc19019e-af7f-43bc-8de8-670e7ef903f4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.357635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.357495    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc19019e-af7f-43bc-8de8-670e7ef903f4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.357635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.357543    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv4dz\" (UniqueName: \"kubernetes.io/projected/bc19019e-af7f-43bc-8de8-670e7ef903f4-kube-api-access-vv4dz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.357895 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.357660    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc19019e-af7f-43bc-8de8-670e7ef903f4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.372104 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.372075    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Oct 30 22:05:24.423413 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.423380    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"]
Oct 30 22:05:24.459027 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.458989    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv4dz\" (UniqueName: \"kubernetes.io/projected/bc19019e-af7f-43bc-8de8-670e7ef903f4-kube-api-access-vv4dz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.459219 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.459130    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc19019e-af7f-43bc-8de8-670e7ef903f4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.459219 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.459162    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc19019e-af7f-43bc-8de8-670e7ef903f4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.459219 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.459196    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc19019e-af7f-43bc-8de8-670e7ef903f4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.459401 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.459239    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc19019e-af7f-43bc-8de8-670e7ef903f4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.460233 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.460169    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc19019e-af7f-43bc-8de8-670e7ef903f4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.461152 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.461130    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc19019e-af7f-43bc-8de8-670e7ef903f4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.461918 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.461896    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc19019e-af7f-43bc-8de8-670e7ef903f4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.462564 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.462517    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc19019e-af7f-43bc-8de8-670e7ef903f4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.463650 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.463627    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc19019e-af7f-43bc-8de8-670e7ef903f4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.466065 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.466041    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc19019e-af7f-43bc-8de8-670e7ef903f4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.493382 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.493352    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:24.523479 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.523452    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv4dz\" (UniqueName: \"kubernetes.io/projected/bc19019e-af7f-43bc-8de8-670e7ef903f4-kube-api-access-vv4dz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4\" (UID: \"bc19019e-af7f-43bc-8de8-670e7ef903f4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:24.630663 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:24.630553    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:25.030209 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:25.030112    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"]
Oct 30 22:05:25.033322 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:05:25.033286    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc19019e_af7f_43bc_8de8_670e7ef903f4.slice/crio-0e2f542363fbd40a7d7a9d6baa43e68b7bd8143af34421447ce98bef3266696a WatchSource:0}: Error finding container 0e2f542363fbd40a7d7a9d6baa43e68b7bd8143af34421447ce98bef3266696a: Status 404 returned error can't find the container with id 0e2f542363fbd40a7d7a9d6baa43e68b7bd8143af34421447ce98bef3266696a
Oct 30 22:05:25.654556 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:25.654522    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4" event={"ID":"bc19019e-af7f-43bc-8de8-670e7ef903f4","Type":"ContainerStarted","Data":"0e2f542363fbd40a7d7a9d6baa43e68b7bd8143af34421447ce98bef3266696a"}
Oct 30 22:05:25.957306 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:25.957206    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:25.969522 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:25.969495    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:26.661120 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:26.661087    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4" event={"ID":"bc19019e-af7f-43bc-8de8-670e7ef903f4","Type":"ContainerStarted","Data":"acb8614f3156ecddfb431213c163abcda251d4b1a31ba60492df2dc3e7d9b4ad"}
Oct 30 22:05:26.672106 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:26.672077    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-dzjzr"
Oct 30 22:05:26.780951 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:26.780893    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4" podStartSLOduration=2.182466396 podStartE2EDuration="2.780874948s" totalImagesPullingTime="598.408552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:26.779868597 +0000 UTC m=+641.510725741" watchObservedRunningTime="2026-10-30 22:05:26.780874948 +0000 UTC m=+641.511732092"
Oct 30 22:05:27.630917 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:27.630891    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:27.661735 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:27.661693    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:29.365329 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:29.365296    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:29.381097 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:29.381073    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:29.688089 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:29.688012    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-jdp6j"
Oct 30 22:05:30.494149 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.494118    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"]
Oct 30 22:05:30.497656 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.497639    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.604161 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.604129    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"]
Oct 30 22:05:30.623019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.622989    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35018678-433d-44e0-9188-4896dcd42d86-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.623019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.623024    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35018678-433d-44e0-9188-4896dcd42d86-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.623249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.623135    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35018678-433d-44e0-9188-4896dcd42d86-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.623312 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.623259    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.623363 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.623313    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.623405 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.623384    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.623451 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.623404    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.623451 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.623430    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl2ct\" (UniqueName: \"kubernetes.io/projected/35018678-433d-44e0-9188-4896dcd42d86-kube-api-access-cl2ct\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.623580 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.623562    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.724510 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.724476    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35018678-433d-44e0-9188-4896dcd42d86-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.724700 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.724518    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.724700 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.724555    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.724700 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.724576    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.724700 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.724621    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.724700 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.724659    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl2ct\" (UniqueName: \"kubernetes.io/projected/35018678-433d-44e0-9188-4896dcd42d86-kube-api-access-cl2ct\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.724700 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.724693    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.725062 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.724768    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35018678-433d-44e0-9188-4896dcd42d86-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.725062 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.724794    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35018678-433d-44e0-9188-4896dcd42d86-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.725062 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.725052    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.725218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.725159    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.725218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.725182    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.725325 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.725292    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.725686 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.725664    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35018678-433d-44e0-9188-4896dcd42d86-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.726854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.726831    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.727172 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.727154    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35018678-433d-44e0-9188-4896dcd42d86-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.787153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.787072    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35018678-433d-44e0-9188-4896dcd42d86-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.787291 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.787187    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl2ct\" (UniqueName: \"kubernetes.io/projected/35018678-433d-44e0-9188-4896dcd42d86-kube-api-access-cl2ct\") pod \"maas-default-gateway-openshift-default-76597d6855-cdzxg\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:30.818796 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:30.818753    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:31.253929 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:31.253899    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"]
Oct 30 22:05:31.255889 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:05:31.255861    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35018678_433d_44e0_9188_4896dcd42d86.slice/crio-36c51fef602d7f37392409ceb69d537f2464652c7a91ef51d3f7d486478fb1fc WatchSource:0}: Error finding container 36c51fef602d7f37392409ceb69d537f2464652c7a91ef51d3f7d486478fb1fc: Status 404 returned error can't find the container with id 36c51fef602d7f37392409ceb69d537f2464652c7a91ef51d3f7d486478fb1fc
Oct 30 22:05:31.258164 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:31.258137    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:05:31.258231 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:31.258199    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:05:31.258231 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:31.258227    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:05:31.700614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:31.700542    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg" event={"ID":"35018678-433d-44e0-9188-4896dcd42d86","Type":"ContainerStarted","Data":"4c9df31cd1eb2d48a5b79d6e674f094ef34efa3582c1ddedeaa626a8721e8e25"}
Oct 30 22:05:31.701087 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:31.700622    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg" event={"ID":"35018678-433d-44e0-9188-4896dcd42d86","Type":"ContainerStarted","Data":"36c51fef602d7f37392409ceb69d537f2464652c7a91ef51d3f7d486478fb1fc"}
Oct 30 22:05:31.818722 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:31.818684    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:31.829238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:31.828912    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg" podStartSLOduration=1.828894153 podStartE2EDuration="1.828894153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:31.82821315 +0000 UTC m=+646.559070499" watchObservedRunningTime="2026-10-30 22:05:31.828894153 +0000 UTC m=+646.559751297"
Oct 30 22:05:32.821243 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:32.821207    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-cdzxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 22:05:32.821855 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:32.821824    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg" podUID="35018678-433d-44e0-9188-4896dcd42d86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 22:05:33.819101 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:33.819060    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-cdzxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 22:05:33.819275 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:33.819129    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg" podUID="35018678-433d-44e0-9188-4896dcd42d86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 22:05:34.631771 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:34.631733    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:34.644154 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:34.644128    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:34.791056 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:34.791030    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4"
Oct 30 22:05:34.819506 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:34.819479    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-cdzxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 22:05:34.819676 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:34.819526    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg" podUID="35018678-433d-44e0-9188-4896dcd42d86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 22:05:35.818705 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:35.818668    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-cdzxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 22:05:35.819101 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:35.818720    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg" podUID="35018678-433d-44e0-9188-4896dcd42d86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 22:05:36.819577 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:36.819546    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-cdzxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 22:05:36.819973 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:36.819613    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg" podUID="35018678-433d-44e0-9188-4896dcd42d86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 22:05:37.538022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:37.537981    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:05:37.818917 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:37.818883    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-cdzxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 22:05:37.819084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:37.818939    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg" podUID="35018678-433d-44e0-9188-4896dcd42d86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 22:05:38.818754 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:38.818717    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-cdzxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 22:05:38.819159 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:38.818781    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg" podUID="35018678-433d-44e0-9188-4896dcd42d86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 22:05:39.823739 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:39.823712    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:39.824229 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:39.824207    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:39.825025 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:39.824998    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:05:43.160939 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:05:43.160903    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:05:50.993216 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:50.993172    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6859d556b5-bq4vb"]
Oct 30 22:05:50.998511 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:50.998494    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6859d556b5-bq4vb"
Oct 30 22:05:51.058274 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:51.058253    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6859d556b5-bq4vb"]
Oct 30 22:05:51.152004 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:51.151973    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw2d5\" (UniqueName: \"kubernetes.io/projected/845284a3-14ec-44c3-b284-ab3fd6b086c3-kube-api-access-gw2d5\") pod \"authorino-6859d556b5-bq4vb\" (UID: \"845284a3-14ec-44c3-b284-ab3fd6b086c3\") " pod="kuadrant-system/authorino-6859d556b5-bq4vb"
Oct 30 22:05:51.152169 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:51.152033    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/845284a3-14ec-44c3-b284-ab3fd6b086c3-tls-cert\") pod \"authorino-6859d556b5-bq4vb\" (UID: \"845284a3-14ec-44c3-b284-ab3fd6b086c3\") " pod="kuadrant-system/authorino-6859d556b5-bq4vb"
Oct 30 22:05:51.252915 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:51.252832    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw2d5\" (UniqueName: \"kubernetes.io/projected/845284a3-14ec-44c3-b284-ab3fd6b086c3-kube-api-access-gw2d5\") pod \"authorino-6859d556b5-bq4vb\" (UID: \"845284a3-14ec-44c3-b284-ab3fd6b086c3\") " pod="kuadrant-system/authorino-6859d556b5-bq4vb"
Oct 30 22:05:51.252915 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:51.252879    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/845284a3-14ec-44c3-b284-ab3fd6b086c3-tls-cert\") pod \"authorino-6859d556b5-bq4vb\" (UID: \"845284a3-14ec-44c3-b284-ab3fd6b086c3\") " pod="kuadrant-system/authorino-6859d556b5-bq4vb"
Oct 30 22:05:51.255373 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:51.255347    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/845284a3-14ec-44c3-b284-ab3fd6b086c3-tls-cert\") pod \"authorino-6859d556b5-bq4vb\" (UID: \"845284a3-14ec-44c3-b284-ab3fd6b086c3\") " pod="kuadrant-system/authorino-6859d556b5-bq4vb"
Oct 30 22:05:51.273093 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:51.273062    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:51.315033 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:51.315001    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw2d5\" (UniqueName: \"kubernetes.io/projected/845284a3-14ec-44c3-b284-ab3fd6b086c3-kube-api-access-gw2d5\") pod \"authorino-6859d556b5-bq4vb\" (UID: \"845284a3-14ec-44c3-b284-ab3fd6b086c3\") " pod="kuadrant-system/authorino-6859d556b5-bq4vb"
Oct 30 22:05:51.498797 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:51.498741    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:51.610669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:51.610640    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6859d556b5-bq4vb"
Oct 30 22:05:52.002364 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:52.002340    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6859d556b5-bq4vb"]
Oct 30 22:05:52.004460 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:05:52.004433    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod845284a3_14ec_44c3_b284_ab3fd6b086c3.slice/crio-ed96cb4d8ccd58035fd6b3a4dbb00f39c201afb48ccb3e8d8a200d3a5c89c066 WatchSource:0}: Error finding container ed96cb4d8ccd58035fd6b3a4dbb00f39c201afb48ccb3e8d8a200d3a5c89c066: Status 404 returned error can't find the container with id ed96cb4d8ccd58035fd6b3a4dbb00f39c201afb48ccb3e8d8a200d3a5c89c066
Oct 30 22:05:52.881880 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:52.881842    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6859d556b5-bq4vb" event={"ID":"845284a3-14ec-44c3-b284-ab3fd6b086c3","Type":"ContainerStarted","Data":"ed96cb4d8ccd58035fd6b3a4dbb00f39c201afb48ccb3e8d8a200d3a5c89c066"}
Oct 30 22:05:53.889603 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:53.889564    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6859d556b5-bq4vb" event={"ID":"845284a3-14ec-44c3-b284-ab3fd6b086c3","Type":"ContainerStarted","Data":"6a39c173f723ada569d333905f1bd424721cde9ea6d8ea9930eb44649288b27a"}
Oct 30 22:05:54.006873 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.006771    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6859d556b5-bq4vb" podStartSLOduration=2.353789266 podStartE2EDuration="4.006756378s" totalImagesPullingTime="1.652967112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:54.00554833 +0000 UTC m=+668.736405486" watchObservedRunningTime="2026-10-30 22:05:54.006756378 +0000 UTC m=+668.737613521"
Oct 30 22:05:54.039765 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.039733    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59fd5995d6-xwxfc"]
Oct 30 22:05:54.039939 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.039909    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-59fd5995d6-xwxfc" podUID="66f2642b-c4d8-4422-a2a3-038f8b6d7473" containerName="authorino" containerID="cri-o://06f062655384d6dc123fe4e9ff50cf8aee6e4ed32aa1495a5030fa43799a946a" gracePeriod=30
Oct 30 22:05:54.298218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.298190    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59fd5995d6-xwxfc"
Oct 30 22:05:54.383729 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.383689    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66f2642b-c4d8-4422-a2a3-038f8b6d7473-tls-cert\" (UniqueName: \"kubernetes.io/secret/66f2642b-c4d8-4422-a2a3-038f8b6d7473-tls-cert\") pod \"66f2642b-c4d8-4422-a2a3-038f8b6d7473\" (UID: \"66f2642b-c4d8-4422-a2a3-038f8b6d7473\") "
Oct 30 22:05:54.383906 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.383772    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66f2642b-c4d8-4422-a2a3-038f8b6d7473-kube-api-access-9t4vb\" (UniqueName: \"kubernetes.io/projected/66f2642b-c4d8-4422-a2a3-038f8b6d7473-kube-api-access-9t4vb\") pod \"66f2642b-c4d8-4422-a2a3-038f8b6d7473\" (UID: \"66f2642b-c4d8-4422-a2a3-038f8b6d7473\") "
Oct 30 22:05:54.385725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.385697    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66f2642b-c4d8-4422-a2a3-038f8b6d7473-kube-api-access-9t4vb" pod "66f2642b-c4d8-4422-a2a3-038f8b6d7473" (UID: "66f2642b-c4d8-4422-a2a3-038f8b6d7473"). InnerVolumeSpecName "kube-api-access-9t4vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:05:54.394897 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.394874    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f2642b-c4d8-4422-a2a3-038f8b6d7473-tls-cert" pod "66f2642b-c4d8-4422-a2a3-038f8b6d7473" (UID: "66f2642b-c4d8-4422-a2a3-038f8b6d7473"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:05:54.485236 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.485185    5258 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/66f2642b-c4d8-4422-a2a3-038f8b6d7473-tls-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:54.485236 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.485240    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t4vb\" (UniqueName: \"kubernetes.io/projected/66f2642b-c4d8-4422-a2a3-038f8b6d7473-kube-api-access-9t4vb\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:54.896605 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.896559    5258 generic.go:356] "Generic (PLEG): container finished" podID="66f2642b-c4d8-4422-a2a3-038f8b6d7473" containerID="06f062655384d6dc123fe4e9ff50cf8aee6e4ed32aa1495a5030fa43799a946a" exitCode=0
Oct 30 22:05:54.897076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.896627    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59fd5995d6-xwxfc"
Oct 30 22:05:54.897076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.896640    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59fd5995d6-xwxfc" event={"ID":"66f2642b-c4d8-4422-a2a3-038f8b6d7473","Type":"ContainerDied","Data":"06f062655384d6dc123fe4e9ff50cf8aee6e4ed32aa1495a5030fa43799a946a"}
Oct 30 22:05:54.897076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.896690    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59fd5995d6-xwxfc" event={"ID":"66f2642b-c4d8-4422-a2a3-038f8b6d7473","Type":"ContainerDied","Data":"89ee393a51de115a3eeeb569a277eaae126f46d5f5a34e78e6ba78c17e88ecec"}
Oct 30 22:05:54.897076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.896715    5258 scope.go:122] "RemoveContainer" containerID="06f062655384d6dc123fe4e9ff50cf8aee6e4ed32aa1495a5030fa43799a946a"
Oct 30 22:05:54.908679 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.908662    5258 scope.go:122] "RemoveContainer" containerID="06f062655384d6dc123fe4e9ff50cf8aee6e4ed32aa1495a5030fa43799a946a"
Oct 30 22:05:54.908986 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:05:54.908963    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06f062655384d6dc123fe4e9ff50cf8aee6e4ed32aa1495a5030fa43799a946a\": container with ID starting with 06f062655384d6dc123fe4e9ff50cf8aee6e4ed32aa1495a5030fa43799a946a not found: ID does not exist" containerID="06f062655384d6dc123fe4e9ff50cf8aee6e4ed32aa1495a5030fa43799a946a"
Oct 30 22:05:54.909087 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:54.908992    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06f062655384d6dc123fe4e9ff50cf8aee6e4ed32aa1495a5030fa43799a946a"} err="failed to get container status \"06f062655384d6dc123fe4e9ff50cf8aee6e4ed32aa1495a5030fa43799a946a\": rpc error: code = NotFound desc = could not find container \"06f062655384d6dc123fe4e9ff50cf8aee6e4ed32aa1495a5030fa43799a946a\": container with ID starting with 06f062655384d6dc123fe4e9ff50cf8aee6e4ed32aa1495a5030fa43799a946a not found: ID does not exist"
Oct 30 22:05:55.067044 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:55.067010    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59fd5995d6-xwxfc"]
Oct 30 22:05:55.069789 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:55.069764    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59fd5995d6-xwxfc"]
Oct 30 22:05:55.390662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:05:55.390046    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66f2642b-c4d8-4422-a2a3-038f8b6d7473" path="/var/lib/kubelet/pods/66f2642b-c4d8-4422-a2a3-038f8b6d7473/volumes"
Oct 30 22:06:00.923409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:00.923368    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:01.138270 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:01.138232    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:13.159616 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:06:13.159566    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:06:19.013885 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:19.013847    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:26.002061 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:26.002022    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:26.564186 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:26.564154    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:28.296208 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:28.296162    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:28.601072 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:28.601040    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:30.173964 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:30.173933    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:30.389528 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:30.389496    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:43.159387 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:06:43.159349    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:06:57.559489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:57.559396    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:57.772039 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:57.771995    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:58.069855 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.069818    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"]
Oct 30 22:06:58.070303 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.070289    5258 cpu_manager.go:414] "containerMap: removing container" podUID="66f2642b-c4d8-4422-a2a3-038f8b6d7473" containerName="authorino"
Oct 30 22:06:58.070350 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.070305    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66f2642b-c4d8-4422-a2a3-038f8b6d7473" containerName="authorino"
Oct 30 22:06:58.070388 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.070379    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="66f2642b-c4d8-4422-a2a3-038f8b6d7473" containerName="authorino"
Oct 30 22:06:58.074609 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.074582    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.127907 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.127885    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-77cb1f-openshift-default-dockercfg-ttk97\""
Oct 30 22:06:58.174579 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.174544    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-podinfo\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.174579 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.174604    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-credential-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.174836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.174631    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-data\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.174836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.174662    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istiod-ca-cert\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.174836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.174686    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-workload-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.174836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.174723    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-workload-certs\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.174836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.174750    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-token\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.174836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.174778    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f8hp\" (UniqueName: \"kubernetes.io/projected/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-kube-api-access-5f8hp\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.174836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.174809    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-envoy\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.180203 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.180175    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"]
Oct 30 22:06:58.226725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.226693    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:58.276362 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.276335    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-podinfo\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.276532 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.276368    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-credential-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.276532 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.276390    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-data\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.276532 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.276420    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istiod-ca-cert\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.276532 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.276445    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-workload-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.276532 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.276479    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-workload-certs\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.276532 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.276506    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-token\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.276969 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.276540    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f8hp\" (UniqueName: \"kubernetes.io/projected/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-kube-api-access-5f8hp\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.276969 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.276604    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-envoy\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.276969 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.276848    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-credential-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.277140 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.277124    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-workload-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.277460 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.277227    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-data\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.279992 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.277875    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-workload-certs\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.281063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.281041    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istiod-ca-cert\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.284359 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.284314    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-envoy\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.285452 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.285428    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-podinfo\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.342018 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.341943    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-token\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.342206 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.342179    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f8hp\" (UniqueName: \"kubernetes.io/projected/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-kube-api-access-5f8hp\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.387464 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.387426    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:58.558226 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.558173    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:58.732395 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.732315    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"]
Oct 30 22:06:58.737076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.737053    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.781116 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.781089    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aba4b2cc-918e-4a92-ba56-23066538cb59-istiod-ca-cert\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.781283 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.781132    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-podinfo\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.781340 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.781281    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-workload-certs\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.781340 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.781323    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-token\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.781486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.781462    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-envoy\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.781537 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.781522    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-data\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.781656 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.781639    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krmqm\" (UniqueName: \"kubernetes.io/projected/aba4b2cc-918e-4a92-ba56-23066538cb59-kube-api-access-krmqm\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.781713 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.781682    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-workload-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.781763 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.781709    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-credential-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.790988 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.790952    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-c76d9e-openshift-default-dockercfg-r2lmn\""
Oct 30 22:06:58.799348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.799323    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"]
Oct 30 22:06:58.822262 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.822243    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"]
Oct 30 22:06:58.824463 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:06:58.824436    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad7c750_19d5_4dfd_b9d9_0a51e8696cad.slice/crio-5c22535876c871ddf4f9774f8e61f1c74203fc1cd65ab7407f273e9d1f9c48f7 WatchSource:0}: Error finding container 5c22535876c871ddf4f9774f8e61f1c74203fc1cd65ab7407f273e9d1f9c48f7: Status 404 returned error can't find the container with id 5c22535876c871ddf4f9774f8e61f1c74203fc1cd65ab7407f273e9d1f9c48f7
Oct 30 22:06:58.825437 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.825407    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:58.826771 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.826738    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:06:58.826857 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.826817    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:06:58.826893 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.826868    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:06:58.882660 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.882631    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-workload-certs\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.882787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.882702    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-token\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.883447 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.883421    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-envoy\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.883516 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.883494    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-data\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.883578 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.883550    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krmqm\" (UniqueName: \"kubernetes.io/projected/aba4b2cc-918e-4a92-ba56-23066538cb59-kube-api-access-krmqm\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.883727 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.883609    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-workload-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.883727 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.883637    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-credential-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.883833 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.883725    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aba4b2cc-918e-4a92-ba56-23066538cb59-istiod-ca-cert\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.883833 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.883759    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-podinfo\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.884955 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.884929    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-workload-certs\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.886332 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.886207    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-credential-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.887842 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.887440    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-workload-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.888035 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.888008    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aba4b2cc-918e-4a92-ba56-23066538cb59-istiod-ca-cert\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.888259 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.888238    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-data\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.889031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.889007    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-podinfo\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.890664 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.890640    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-envoy\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.948830 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.948800    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-token\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:58.949243 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:58.949207    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krmqm\" (UniqueName: \"kubernetes.io/projected/aba4b2cc-918e-4a92-ba56-23066538cb59-kube-api-access-krmqm\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:59.051281 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.051200    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:06:59.056006 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.055962    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:59.256844 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.256810    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2" event={"ID":"bad7c750-19d5-4dfd-b9d9-0a51e8696cad","Type":"ContainerStarted","Data":"8c5ed8f60becddecce10e823a01fb98958d669d12669bf97f8103a4a1886082e"}
Oct 30 22:06:59.257015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.256860    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2" event={"ID":"bad7c750-19d5-4dfd-b9d9-0a51e8696cad","Type":"ContainerStarted","Data":"5c22535876c871ddf4f9774f8e61f1c74203fc1cd65ab7407f273e9d1f9c48f7"}
Oct 30 22:06:59.294675 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.294639    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:59.380070 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.380011    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2" podStartSLOduration=1.379993124 podStartE2EDuration="1.379993124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:06:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:06:59.378358279 +0000 UTC m=+734.109215423" watchObservedRunningTime="2026-10-30 22:06:59.379993124 +0000 UTC m=+734.110850267"
Oct 30 22:06:59.388292 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.388268    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:59.392694 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.392669    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"]
Oct 30 22:06:59.396059 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.396038    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:06:59.396172 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.396108    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.449261 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.449229    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-13b8d8-openshift-default-dockercfg-8442c\""
Oct 30 22:06:59.457882 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.457856    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"]
Oct 30 22:06:59.489439 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.489218    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"]
Oct 30 22:06:59.489777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.489754    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-token\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.489883 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.489872    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-workload-certs\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.489925 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.489902    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv87h\" (UniqueName: \"kubernetes.io/projected/d2dcd803-1841-4a81-a92c-0f9814962b94-kube-api-access-zv87h\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.489985 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.489973    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-data\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.490029 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.490014    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-envoy\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.490071 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.490059    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-credential-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.490135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.490115    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-workload-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.490242 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.490223    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-podinfo\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.490287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.490268    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2dcd803-1841-4a81-a92c-0f9814962b94-istiod-ca-cert\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.492484 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:06:59.492462    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba4b2cc_918e_4a92_ba56_23066538cb59.slice/crio-00957fc4c71154c851e1c30bb71cc8e956ca90decad2db072816638802b2b4be WatchSource:0}: Error finding container 00957fc4c71154c851e1c30bb71cc8e956ca90decad2db072816638802b2b4be: Status 404 returned error can't find the container with id 00957fc4c71154c851e1c30bb71cc8e956ca90decad2db072816638802b2b4be
Oct 30 22:06:59.495240 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.495211    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:06:59.495349 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.495268    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:06:59.495349 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.495299    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:06:59.548064 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.548028    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:59.591101 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.591071    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-workload-certs\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.591229 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.591126    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv87h\" (UniqueName: \"kubernetes.io/projected/d2dcd803-1841-4a81-a92c-0f9814962b94-kube-api-access-zv87h\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.591229 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.591192    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-data\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.591345 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.591243    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-envoy\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.591345 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.591315    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-credential-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.591445 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.591342    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-workload-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.591445 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.591386    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-podinfo\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.591445 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.591422    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2dcd803-1841-4a81-a92c-0f9814962b94-istiod-ca-cert\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.591618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.591516    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-token\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.591618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.591532    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-data\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.591618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.591568    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-credential-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.591785 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.591710    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-workload-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.591785 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.591749    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-workload-certs\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.592297 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.592274    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2dcd803-1841-4a81-a92c-0f9814962b94-istiod-ca-cert\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.593437 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.593411    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-envoy\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.593779 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.593761    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-podinfo\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.653962 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.653895    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-token\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.654108 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.654078    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv87h\" (UniqueName: \"kubernetes.io/projected/d2dcd803-1841-4a81-a92c-0f9814962b94-kube-api-access-zv87h\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.709182 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.709152    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:06:59.794651 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:06:59.793630    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:00.021541 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.021465    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:00.148672 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.148638    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"]
Oct 30 22:07:00.153403 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:07:00.153370    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2dcd803_1841_4a81_a92c_0f9814962b94.slice/crio-ae185b6096adbac8284893261c5540d70bd66ffd64272bd08e8a0121b76ca81a WatchSource:0}: Error finding container ae185b6096adbac8284893261c5540d70bd66ffd64272bd08e8a0121b76ca81a: Status 404 returned error can't find the container with id ae185b6096adbac8284893261c5540d70bd66ffd64272bd08e8a0121b76ca81a
Oct 30 22:07:00.155892 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.155861    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:00.155986 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.155923    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:00.155986 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.155953    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:00.250373 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.250334    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:00.265201 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.265168    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm" event={"ID":"aba4b2cc-918e-4a92-ba56-23066538cb59","Type":"ContainerStarted","Data":"88482e144279642753d2408a24f2caa708a0b062e126fb05e584628ee49d3e9a"}
Oct 30 22:07:00.265393 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.265264    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm" event={"ID":"aba4b2cc-918e-4a92-ba56-23066538cb59","Type":"ContainerStarted","Data":"00957fc4c71154c851e1c30bb71cc8e956ca90decad2db072816638802b2b4be"}
Oct 30 22:07:00.268714 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.268686    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q" event={"ID":"d2dcd803-1841-4a81-a92c-0f9814962b94","Type":"ContainerStarted","Data":"c5cba5d8ff1eb40d31cb19e4f4a7226c47128e0333a528ccacf23d1c816c1fd4"}
Oct 30 22:07:00.268714 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.268732    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q" event={"ID":"d2dcd803-1841-4a81-a92c-0f9814962b94","Type":"ContainerStarted","Data":"ae185b6096adbac8284893261c5540d70bd66ffd64272bd08e8a0121b76ca81a"}
Oct 30 22:07:00.268964 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.268760    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:07:00.269917 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.269890    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:07:00.389908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.389775    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm" podStartSLOduration=2.389756354 podStartE2EDuration="2.389756354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:06:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:00.387440093 +0000 UTC m=+735.118297236" watchObservedRunningTime="2026-10-30 22:07:00.389756354 +0000 UTC m=+735.120613497"
Oct 30 22:07:00.486674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.486631    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:00.647814 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.647713    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q" podStartSLOduration=1.6476932149999999 podStartE2EDuration="1.647693215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:06:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:00.629067645 +0000 UTC m=+735.359924790" watchObservedRunningTime="2026-10-30 22:07:00.647693215 +0000 UTC m=+735.378550357"
Oct 30 22:07:00.709841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.709814    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:07:00.716202 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:00.716152    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:01.052015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:01.051944    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:07:01.056618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:01.056568    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:07:01.272948 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:01.272915    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:07:01.273860 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:01.273836    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:07:01.715430 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:01.715400    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:07:02.277963 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:02.277932    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:07:02.278951 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:02.278932    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:07:02.560353 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:02.560321    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:02.781060 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:02.781022    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:03.777709 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:03.777670    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:04.022836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:04.022805    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:05.567469 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:05.567435    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:05.812244 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:05.812212    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:06.030084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.029994    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:06.251436 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.251395    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:06.418507 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.418475    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"]
Oct 30 22:07:06.422292 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.422275    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"
Oct 30 22:07:06.479665 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.479643    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-77cb1f\""
Oct 30 22:07:06.480421 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.480397    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:06.528527 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.528499    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-77cb1f-dockercfg-gdvfz\""
Oct 30 22:07:06.531144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.531118    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"]
Oct 30 22:07:06.568319 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.567154    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns\" (UID: \"f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"
Oct 30 22:07:06.568319 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.567207    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6ptl\" (UniqueName: \"kubernetes.io/projected/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b-kube-api-access-d6ptl\") pod \"payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns\" (UID: \"f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"
Oct 30 22:07:06.668654 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.668564    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns\" (UID: \"f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"
Oct 30 22:07:06.668654 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.668619    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6ptl\" (UniqueName: \"kubernetes.io/projected/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b-kube-api-access-d6ptl\") pod \"payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns\" (UID: \"f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"
Oct 30 22:07:06.669620 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.669566    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns\" (UID: \"f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"
Oct 30 22:07:06.699249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.699206    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:06.731317 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.731290    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6ptl\" (UniqueName: \"kubernetes.io/projected/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b-kube-api-access-d6ptl\") pod \"payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns\" (UID: \"f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"
Oct 30 22:07:06.736119 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:06.736094    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"
Oct 30 22:07:07.012887 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:07.012809    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:07.127989 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:07.127956    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"]
Oct 30 22:07:07.131786 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:07:07.131755    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7a5fdf5_c6fe_4bc9_9f02_8c10928e1b6b.slice/crio-5fbf0089d5b92bbda6f38d66a6ff25c66fcc749874807bb3c8f1f8cb2d0a4495 WatchSource:0}: Error finding container 5fbf0089d5b92bbda6f38d66a6ff25c66fcc749874807bb3c8f1f8cb2d0a4495: Status 404 returned error can't find the container with id 5fbf0089d5b92bbda6f38d66a6ff25c66fcc749874807bb3c8f1f8cb2d0a4495
Oct 30 22:07:07.257707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:07.257680    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:07.309295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:07.309268    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns" event={"ID":"f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b","Type":"ContainerStarted","Data":"5fbf0089d5b92bbda6f38d66a6ff25c66fcc749874807bb3c8f1f8cb2d0a4495"}
Oct 30 22:07:09.212685 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:09.212641    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:09.482407 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:09.482327    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:09.730402 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:09.730370    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:10.331057 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:10.331025    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns" event={"ID":"f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b","Type":"ContainerStarted","Data":"973c0e27d9fd4d351076b00aeeffcb6a4727fbd70bef9b6ce61601977f9fcb8b"}
Oct 30 22:07:10.331471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:10.331080    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"
Oct 30 22:07:10.449765 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:10.449709    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns" podStartSLOduration=1.651810309 podStartE2EDuration="4.449693136s" totalImagesPullingTime="2.797882827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:10.446846258 +0000 UTC m=+745.177703401" watchObservedRunningTime="2026-10-30 22:07:10.449693136 +0000 UTC m=+745.180550269"
Oct 30 22:07:10.962876 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:10.962838    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:11.181751 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.181712    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:11.320725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.320690    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"]
Oct 30 22:07:11.324680 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.324659    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"
Oct 30 22:07:11.419263 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.419220    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxtqd\" (UniqueName: \"kubernetes.io/projected/6d58c008-7506-4ab0-9caa-1c57367f9f63-kube-api-access-nxtqd\") pod \"payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7\" (UID: \"6d58c008-7506-4ab0-9caa-1c57367f9f63\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"
Oct 30 22:07:11.419916 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.419892    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d58c008-7506-4ab0-9caa-1c57367f9f63-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7\" (UID: \"6d58c008-7506-4ab0-9caa-1c57367f9f63\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"
Oct 30 22:07:11.426454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.426424    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w6-c76d9e\""
Oct 30 22:07:11.426633 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.426507    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w6-c76d9e-dockercfg-dqlpw\""
Oct 30 22:07:11.429729 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.429704    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"]
Oct 30 22:07:11.478131 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.478090    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"]
Oct 30 22:07:11.481862 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.481840    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"
Oct 30 22:07:11.520802 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.520778    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d58c008-7506-4ab0-9caa-1c57367f9f63-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7\" (UID: \"6d58c008-7506-4ab0-9caa-1c57367f9f63\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"
Oct 30 22:07:11.520924 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.520894    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxtqd\" (UniqueName: \"kubernetes.io/projected/6d58c008-7506-4ab0-9caa-1c57367f9f63-kube-api-access-nxtqd\") pod \"payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7\" (UID: \"6d58c008-7506-4ab0-9caa-1c57367f9f63\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"
Oct 30 22:07:11.521423 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.521403    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d58c008-7506-4ab0-9caa-1c57367f9f63-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7\" (UID: \"6d58c008-7506-4ab0-9caa-1c57367f9f63\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"
Oct 30 22:07:11.535502 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.535476    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"]
Oct 30 22:07:11.583306 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.583250    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxtqd\" (UniqueName: \"kubernetes.io/projected/6d58c008-7506-4ab0-9caa-1c57367f9f63-kube-api-access-nxtqd\") pod \"payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7\" (UID: \"6d58c008-7506-4ab0-9caa-1c57367f9f63\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"
Oct 30 22:07:11.621710 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.621679    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjzlp\" (UniqueName: \"kubernetes.io/projected/c543de65-55b8-44f8-914c-53a1e19cec44-kube-api-access-cjzlp\") pod \"payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr\" (UID: \"c543de65-55b8-44f8-914c-53a1e19cec44\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"
Oct 30 22:07:11.621844 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.621721    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c543de65-55b8-44f8-914c-53a1e19cec44-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr\" (UID: \"c543de65-55b8-44f8-914c-53a1e19cec44\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"
Oct 30 22:07:11.638489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.638465    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"
Oct 30 22:07:11.722642 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.722573    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjzlp\" (UniqueName: \"kubernetes.io/projected/c543de65-55b8-44f8-914c-53a1e19cec44-kube-api-access-cjzlp\") pod \"payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr\" (UID: \"c543de65-55b8-44f8-914c-53a1e19cec44\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"
Oct 30 22:07:11.722783 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.722654    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c543de65-55b8-44f8-914c-53a1e19cec44-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr\" (UID: \"c543de65-55b8-44f8-914c-53a1e19cec44\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"
Oct 30 22:07:11.723563 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.723535    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c543de65-55b8-44f8-914c-53a1e19cec44-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr\" (UID: \"c543de65-55b8-44f8-914c-53a1e19cec44\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"
Oct 30 22:07:11.784842 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.784820    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjzlp\" (UniqueName: \"kubernetes.io/projected/c543de65-55b8-44f8-914c-53a1e19cec44-kube-api-access-cjzlp\") pod \"payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr\" (UID: \"c543de65-55b8-44f8-914c-53a1e19cec44\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"
Oct 30 22:07:11.794469 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:11.794448    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"
Oct 30 22:07:12.017405 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:12.017383    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"]
Oct 30 22:07:12.019405 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:07:12.019372    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d58c008_7506_4ab0_9caa_1c57367f9f63.slice/crio-8ff2f6d075b0d5952b875294540f97206142d1e686f2898b124564d649b34187 WatchSource:0}: Error finding container 8ff2f6d075b0d5952b875294540f97206142d1e686f2898b124564d649b34187: Status 404 returned error can't find the container with id 8ff2f6d075b0d5952b875294540f97206142d1e686f2898b124564d649b34187
Oct 30 22:07:12.172247 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:12.172223    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"]
Oct 30 22:07:12.174959 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:07:12.174931    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc543de65_55b8_44f8_914c_53a1e19cec44.slice/crio-e697d9f39f1492c184ba0a13ff8ddb848809538fa0603d651243ed13641eebcb WatchSource:0}: Error finding container e697d9f39f1492c184ba0a13ff8ddb848809538fa0603d651243ed13641eebcb: Status 404 returned error can't find the container with id e697d9f39f1492c184ba0a13ff8ddb848809538fa0603d651243ed13641eebcb
Oct 30 22:07:12.344460 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:12.344415    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7" event={"ID":"6d58c008-7506-4ab0-9caa-1c57367f9f63","Type":"ContainerStarted","Data":"944c43d0628d522e8e98a0156ee279a1f7f8409bf2db6be9ae6b998f81a58959"}
Oct 30 22:07:12.344656 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:12.344469    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7" event={"ID":"6d58c008-7506-4ab0-9caa-1c57367f9f63","Type":"ContainerStarted","Data":"8ff2f6d075b0d5952b875294540f97206142d1e686f2898b124564d649b34187"}
Oct 30 22:07:12.344656 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:12.344493    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"
Oct 30 22:07:12.346104 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:12.346073    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr" event={"ID":"c543de65-55b8-44f8-914c-53a1e19cec44","Type":"ContainerStarted","Data":"e2b75694363ba71ddb9056e73333f84ee496bd28613b3d38a3ff3d182d0b4446"}
Oct 30 22:07:12.346242 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:12.346117    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr" event={"ID":"c543de65-55b8-44f8-914c-53a1e19cec44","Type":"ContainerStarted","Data":"e697d9f39f1492c184ba0a13ff8ddb848809538fa0603d651243ed13641eebcb"}
Oct 30 22:07:12.346242 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:12.346137    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"
Oct 30 22:07:12.461628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:12.461521    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7" podStartSLOduration=1.4615101830000001 podStartE2EDuration="1.461510183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:12.460477852 +0000 UTC m=+747.191335005" watchObservedRunningTime="2026-10-30 22:07:12.461510183 +0000 UTC m=+747.192367326"
Oct 30 22:07:12.582905 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:12.582852    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr" podStartSLOduration=1.582835494 podStartE2EDuration="1.582835494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:12.577835537 +0000 UTC m=+747.308692682" watchObservedRunningTime="2026-10-30 22:07:12.582835494 +0000 UTC m=+747.313692636"
Oct 30 22:07:13.160702 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:07:13.160666    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:07:14.247854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.247817    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"]
Oct 30 22:07:14.251271 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.251252    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:14.349456 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.349423    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-maas-api-tls\") pod \"maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:14.349628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.349469    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhft5\" (UniqueName: \"kubernetes.io/projected/45402f0f-cea0-4618-aed3-6a60dfa50c20-kube-api-access-lhft5\") pod \"maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:14.349628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.349494    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45402f0f-cea0-4618-aed3-6a60dfa50c20-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:14.349753 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.349695    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-metrics-certs\") pod \"maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:14.352954 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.352932    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-77cb1f-serving-cert\""
Oct 30 22:07:14.353073 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.352959    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:07:14.353073 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.352969    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 22:07:14.353073 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.352981    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:07:14.353073 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.353031    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zj8wn\""
Oct 30 22:07:14.356887 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.356868    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"]
Oct 30 22:07:14.450865 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.450833    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-metrics-certs\") pod \"maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:14.451022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.450915    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-maas-api-tls\") pod \"maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:14.451022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.450940    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhft5\" (UniqueName: \"kubernetes.io/projected/45402f0f-cea0-4618-aed3-6a60dfa50c20-kube-api-access-lhft5\") pod \"maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:14.451022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.450961    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45402f0f-cea0-4618-aed3-6a60dfa50c20-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:14.451140 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:07:14.451053    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-serving-cert: secret "maas-api-e2e-worker-w1-77cb1f-serving-cert" not found
Oct 30 22:07:14.451140 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:07:14.451133    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-maas-api-tls podName:45402f0f-cea0-4618-aed3-6a60dfa50c20 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:14.951115097 +0000 UTC m=+749.681972237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-maas-api-tls") pod "maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8" (UID: "45402f0f-cea0-4618-aed3-6a60dfa50c20") : secret "maas-api-e2e-worker-w1-77cb1f-serving-cert" not found
Oct 30 22:07:14.451744 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.451718    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45402f0f-cea0-4618-aed3-6a60dfa50c20-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:14.453292 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.453274    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-metrics-certs\") pod \"maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:14.514262 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.514148    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:14.517367 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.517345    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhft5\" (UniqueName: \"kubernetes.io/projected/45402f0f-cea0-4618-aed3-6a60dfa50c20-kube-api-access-lhft5\") pod \"maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:14.729224 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.729182    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:14.945993 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.945963    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:14.955067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.955034    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-maas-api-tls\") pod \"maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:14.957574 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:14.957551    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-maas-api-tls\") pod \"maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:15.164431 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:15.164399    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:15.547874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:15.547847    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"]
Oct 30 22:07:15.549765 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:07:15.549724    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45402f0f_cea0_4618_aed3_6a60dfa50c20.slice/crio-45f1a6b6c7bc797256a2502b06c88330ec1b7fda5a02f8496d39b57482496aa6 WatchSource:0}: Error finding container 45f1a6b6c7bc797256a2502b06c88330ec1b7fda5a02f8496d39b57482496aa6: Status 404 returned error can't find the container with id 45f1a6b6c7bc797256a2502b06c88330ec1b7fda5a02f8496d39b57482496aa6
Oct 30 22:07:15.555500 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:15.555468    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:15.827671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:15.827638    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:16.189849 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:16.189765    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:16.370497 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:16.370465    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8" event={"ID":"45402f0f-cea0-4618-aed3-6a60dfa50c20","Type":"ContainerStarted","Data":"45f1a6b6c7bc797256a2502b06c88330ec1b7fda5a02f8496d39b57482496aa6"}
Oct 30 22:07:16.410864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:16.410829    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:16.632490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:16.632444    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:17.694717 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:17.694679    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:07:18.143417 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.143385    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:18.387124 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.387083    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8" event={"ID":"45402f0f-cea0-4618-aed3-6a60dfa50c20","Type":"ContainerStarted","Data":"1418bfe2461a22252dc112bcb1f89e49516a144773c8aab7c7edf36fb5089a8b"}
Oct 30 22:07:18.387338 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.387278    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:18.411908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.411873    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:18.511488 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.511439    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8" podStartSLOduration=2.146178375 podStartE2EDuration="4.511425905s" totalImagesPullingTime="2.36524753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:18.508519178 +0000 UTC m=+753.239376324" watchObservedRunningTime="2026-10-30 22:07:18.511425905 +0000 UTC m=+753.242283047"
Oct 30 22:07:18.686664 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.682173    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"]
Oct 30 22:07:18.706130 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.705935    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"
Oct 30 22:07:18.729746 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.729717    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"]
Oct 30 22:07:18.764612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.759538    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-2a4123\""
Oct 30 22:07:18.764612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.759817    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-2a4123-dockercfg-bbg6l\""
Oct 30 22:07:18.829617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.816221    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7de5d2b-2183-4fce-bff9-3e18fce386e2-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88\" (UID: \"b7de5d2b-2183-4fce-bff9-3e18fce386e2\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"
Oct 30 22:07:18.829910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.829882    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfjdx\" (UniqueName: \"kubernetes.io/projected/b7de5d2b-2183-4fce-bff9-3e18fce386e2-kube-api-access-kfjdx\") pod \"payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88\" (UID: \"b7de5d2b-2183-4fce-bff9-3e18fce386e2\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"
Oct 30 22:07:18.944393 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.944309    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7de5d2b-2183-4fce-bff9-3e18fce386e2-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88\" (UID: \"b7de5d2b-2183-4fce-bff9-3e18fce386e2\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"
Oct 30 22:07:18.944393 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.944349    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfjdx\" (UniqueName: \"kubernetes.io/projected/b7de5d2b-2183-4fce-bff9-3e18fce386e2-kube-api-access-kfjdx\") pod \"payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88\" (UID: \"b7de5d2b-2183-4fce-bff9-3e18fce386e2\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"
Oct 30 22:07:18.945162 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:18.945140    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7de5d2b-2183-4fce-bff9-3e18fce386e2-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88\" (UID: \"b7de5d2b-2183-4fce-bff9-3e18fce386e2\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"
Oct 30 22:07:19.007364 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:19.007327    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfjdx\" (UniqueName: \"kubernetes.io/projected/b7de5d2b-2183-4fce-bff9-3e18fce386e2-kube-api-access-kfjdx\") pod \"payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88\" (UID: \"b7de5d2b-2183-4fce-bff9-3e18fce386e2\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"
Oct 30 22:07:19.081837 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:19.081787    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"
Oct 30 22:07:19.398886 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:19.398848    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:19.483439 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:19.483410    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"]
Oct 30 22:07:19.489447 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:07:19.489399    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7de5d2b_2183_4fce_bff9_3e18fce386e2.slice/crio-6b69f690f1be01098cdd029d8168ee79b32acaf64b96d6de9bd7986fc35d9421 WatchSource:0}: Error finding container 6b69f690f1be01098cdd029d8168ee79b32acaf64b96d6de9bd7986fc35d9421: Status 404 returned error can't find the container with id 6b69f690f1be01098cdd029d8168ee79b32acaf64b96d6de9bd7986fc35d9421
Oct 30 22:07:20.027629 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:20.027583    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:20.248168 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:20.248139    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:20.407380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:20.407345    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88" event={"ID":"b7de5d2b-2183-4fce-bff9-3e18fce386e2","Type":"ContainerStarted","Data":"86083c224a4c8029922d346fe56aee2ee3d0d36ee1cb9c1e2ce4f4be6418d10e"}
Oct 30 22:07:20.407560 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:20.407398    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88" event={"ID":"b7de5d2b-2183-4fce-bff9-3e18fce386e2","Type":"ContainerStarted","Data":"6b69f690f1be01098cdd029d8168ee79b32acaf64b96d6de9bd7986fc35d9421"}
Oct 30 22:07:20.407560 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:20.407456    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"
Oct 30 22:07:20.543492 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:20.543438    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88" podStartSLOduration=2.543423578 podStartE2EDuration="2.543423578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:20.541573592 +0000 UTC m=+755.272430735" watchObservedRunningTime="2026-10-30 22:07:20.543423578 +0000 UTC m=+755.274280720"
Oct 30 22:07:20.803546 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:20.803450    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:21.017658 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:21.017611    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:21.341133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:21.341104    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"
Oct 30 22:07:23.271614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.270923    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:23.380633 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.371804    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"
Oct 30 22:07:23.386927 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.386904    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"
Oct 30 22:07:23.492940 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.492909    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:23.590292 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.590252    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"]
Oct 30 22:07:23.594219 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.594195    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"
Oct 30 22:07:23.634848 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.634814    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jz8p\" (UniqueName: \"kubernetes.io/projected/8891fbb0-53aa-451f-8971-e20fb5db3ddd-kube-api-access-2jz8p\") pod \"payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj\" (UID: \"8891fbb0-53aa-451f-8971-e20fb5db3ddd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"
Oct 30 22:07:23.634980 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.634932    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8891fbb0-53aa-451f-8971-e20fb5db3ddd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj\" (UID: \"8891fbb0-53aa-451f-8971-e20fb5db3ddd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"
Oct 30 22:07:23.669614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.650670    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-97aa64\""
Oct 30 22:07:23.669614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.654719    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-97aa64-dockercfg-pbtgm\""
Oct 30 22:07:23.683086 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.683058    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"]
Oct 30 22:07:23.756614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.752225    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jz8p\" (UniqueName: \"kubernetes.io/projected/8891fbb0-53aa-451f-8971-e20fb5db3ddd-kube-api-access-2jz8p\") pod \"payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj\" (UID: \"8891fbb0-53aa-451f-8971-e20fb5db3ddd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"
Oct 30 22:07:23.756614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.752355    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8891fbb0-53aa-451f-8971-e20fb5db3ddd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj\" (UID: \"8891fbb0-53aa-451f-8971-e20fb5db3ddd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"
Oct 30 22:07:23.756614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.753339    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8891fbb0-53aa-451f-8971-e20fb5db3ddd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj\" (UID: \"8891fbb0-53aa-451f-8971-e20fb5db3ddd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"
Oct 30 22:07:23.815367 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.815333    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jz8p\" (UniqueName: \"kubernetes.io/projected/8891fbb0-53aa-451f-8971-e20fb5db3ddd-kube-api-access-2jz8p\") pod \"payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj\" (UID: \"8891fbb0-53aa-451f-8971-e20fb5db3ddd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"
Oct 30 22:07:23.912094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:23.912018    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"
Oct 30 22:07:24.294067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:24.294041    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"]
Oct 30 22:07:24.296169 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:07:24.296132    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8891fbb0_53aa_451f_8971_e20fb5db3ddd.slice/crio-8ce9ccdcd6e4ce6cb785dee788ea8baf3b52990ba93f1f231344ec880b6eb24b WatchSource:0}: Error finding container 8ce9ccdcd6e4ce6cb785dee788ea8baf3b52990ba93f1f231344ec880b6eb24b: Status 404 returned error can't find the container with id 8ce9ccdcd6e4ce6cb785dee788ea8baf3b52990ba93f1f231344ec880b6eb24b
Oct 30 22:07:24.405391 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:24.405368    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:07:24.433103 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:24.433075    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj" event={"ID":"8891fbb0-53aa-451f-8971-e20fb5db3ddd","Type":"ContainerStarted","Data":"5712df38ff016b222c948c42326f30d33474832a96e77fe005ff189b5f782339"}
Oct 30 22:07:24.433213 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:24.433122    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj" event={"ID":"8891fbb0-53aa-451f-8971-e20fb5db3ddd","Type":"ContainerStarted","Data":"8ce9ccdcd6e4ce6cb785dee788ea8baf3b52990ba93f1f231344ec880b6eb24b"}
Oct 30 22:07:24.433213 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:24.433149    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"
Oct 30 22:07:24.647819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:24.647756    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj" podStartSLOduration=1.647735487 podStartE2EDuration="1.647735487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:24.641495521 +0000 UTC m=+759.372352811" watchObservedRunningTime="2026-10-30 22:07:24.647735487 +0000 UTC m=+759.378592629"
Oct 30 22:07:25.757660 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:25.757620    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:25.980144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:25.980111    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:26.261652 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:26.261619    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"]
Oct 30 22:07:26.265788 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:26.265763    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"
Oct 30 22:07:26.325112 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:26.325083    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"]
Oct 30 22:07:26.371208 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:26.371177    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-075cbb\""
Oct 30 22:07:26.371398 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:26.371381    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-075cbb-dockercfg-znrdq\""
Oct 30 22:07:26.394491 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:26.394463    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ddb2f4d-1a6e-4b97-bada-6997a01536d1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj\" (UID: \"2ddb2f4d-1a6e-4b97-bada-6997a01536d1\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"
Oct 30 22:07:26.394670 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:26.394650    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnfpx\" (UniqueName: \"kubernetes.io/projected/2ddb2f4d-1a6e-4b97-bada-6997a01536d1-kube-api-access-fnfpx\") pod \"payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj\" (UID: \"2ddb2f4d-1a6e-4b97-bada-6997a01536d1\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"
Oct 30 22:07:26.496263 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:26.496225    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnfpx\" (UniqueName: \"kubernetes.io/projected/2ddb2f4d-1a6e-4b97-bada-6997a01536d1-kube-api-access-fnfpx\") pod \"payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj\" (UID: \"2ddb2f4d-1a6e-4b97-bada-6997a01536d1\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"
Oct 30 22:07:26.496402 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:26.496359    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ddb2f4d-1a6e-4b97-bada-6997a01536d1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj\" (UID: \"2ddb2f4d-1a6e-4b97-bada-6997a01536d1\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"
Oct 30 22:07:26.497075 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:26.497049    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ddb2f4d-1a6e-4b97-bada-6997a01536d1-plugins-config-volume\") pod \"payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj\" (UID: \"2ddb2f4d-1a6e-4b97-bada-6997a01536d1\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"
Oct 30 22:07:26.558320 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:26.558286    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnfpx\" (UniqueName: \"kubernetes.io/projected/2ddb2f4d-1a6e-4b97-bada-6997a01536d1-kube-api-access-fnfpx\") pod \"payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj\" (UID: \"2ddb2f4d-1a6e-4b97-bada-6997a01536d1\") " pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"
Oct 30 22:07:26.579854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:26.579834    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"
Oct 30 22:07:26.974886 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:26.974861    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"]
Oct 30 22:07:26.977923 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:07:26.977893    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddb2f4d_1a6e_4b97_bada_6997a01536d1.slice/crio-6e044168ed23c424405aa94aa934070303f53bdaf91af437f027d05b565cc5c9 WatchSource:0}: Error finding container 6e044168ed23c424405aa94aa934070303f53bdaf91af437f027d05b565cc5c9: Status 404 returned error can't find the container with id 6e044168ed23c424405aa94aa934070303f53bdaf91af437f027d05b565cc5c9
Oct 30 22:07:27.454362 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:27.454324    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj" event={"ID":"2ddb2f4d-1a6e-4b97-bada-6997a01536d1","Type":"ContainerStarted","Data":"f4aa2f49f508204679a5d8324906e07a0c649e87c9da39309c234e089d1d7b8e"}
Oct 30 22:07:27.456961 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:27.454394    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj" event={"ID":"2ddb2f4d-1a6e-4b97-bada-6997a01536d1","Type":"ContainerStarted","Data":"6e044168ed23c424405aa94aa934070303f53bdaf91af437f027d05b565cc5c9"}
Oct 30 22:07:27.456961 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:27.454509    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"
Oct 30 22:07:27.492275 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:27.492247    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:07:27.574461 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:27.574410    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj" podStartSLOduration=1.57439361 podStartE2EDuration="1.57439361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:27.573452583 +0000 UTC m=+762.304309725" watchObservedRunningTime="2026-10-30 22:07:27.57439361 +0000 UTC m=+762.305250756"
Oct 30 22:07:28.377616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.377553    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:28.482233 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.482197    5258 generic.go:356] "Generic (PLEG): container finished" podID="aba4b2cc-918e-4a92-ba56-23066538cb59" containerID="88482e144279642753d2408a24f2caa708a0b062e126fb05e584628ee49d3e9a" exitCode=0
Oct 30 22:07:28.482421 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.482269    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm" event={"ID":"aba4b2cc-918e-4a92-ba56-23066538cb59","Type":"ContainerDied","Data":"88482e144279642753d2408a24f2caa708a0b062e126fb05e584628ee49d3e9a"}
Oct 30 22:07:28.482689 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.482670    5258 scope.go:122] "RemoveContainer" containerID="88482e144279642753d2408a24f2caa708a0b062e126fb05e584628ee49d3e9a"
Oct 30 22:07:28.484309 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.484250    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:28.484469 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.484444    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:28.484569 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.484551    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:28.617614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.616108    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:28.738729 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.738653    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"]
Oct 30 22:07:28.742618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.742578    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"
Oct 30 22:07:28.798372 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.798108    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-13b8d8\""
Oct 30 22:07:28.798372 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.798284    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-13b8d8-dockercfg-hck9x\""
Oct 30 22:07:28.803477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.801114    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"]
Oct 30 22:07:28.843615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.829202    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbpxr\" (UniqueName: \"kubernetes.io/projected/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7-kube-api-access-hbpxr\") pod \"payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff\" (UID: \"1e670da5-3e9a-4d99-a5e6-d1251d5efcc7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"
Oct 30 22:07:28.843615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.829315    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff\" (UID: \"1e670da5-3e9a-4d99-a5e6-d1251d5efcc7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"
Oct 30 22:07:28.898565 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.898533    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"]
Oct 30 22:07:28.904021 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.903995    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"
Oct 30 22:07:28.930526 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.930494    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff\" (UID: \"1e670da5-3e9a-4d99-a5e6-d1251d5efcc7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"
Oct 30 22:07:28.930707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.930686    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbpxr\" (UniqueName: \"kubernetes.io/projected/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7-kube-api-access-hbpxr\") pod \"payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff\" (UID: \"1e670da5-3e9a-4d99-a5e6-d1251d5efcc7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"
Oct 30 22:07:28.931262 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.931245    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff\" (UID: \"1e670da5-3e9a-4d99-a5e6-d1251d5efcc7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"
Oct 30 22:07:28.938988 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.938956    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"]
Oct 30 22:07:28.993534 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:28.993460    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbpxr\" (UniqueName: \"kubernetes.io/projected/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7-kube-api-access-hbpxr\") pod \"payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff\" (UID: \"1e670da5-3e9a-4d99-a5e6-d1251d5efcc7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"
Oct 30 22:07:29.031609 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:29.031555    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj\" (UID: \"3dd9adb3-a2d7-4f2b-8985-d043bf78cecc\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"
Oct 30 22:07:29.031780 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:29.031719    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcg4t\" (UniqueName: \"kubernetes.io/projected/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc-kube-api-access-tcg4t\") pod \"payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj\" (UID: \"3dd9adb3-a2d7-4f2b-8985-d043bf78cecc\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"
Oct 30 22:07:29.076615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:29.075801    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"
Oct 30 22:07:29.132668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:29.132628    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj\" (UID: \"3dd9adb3-a2d7-4f2b-8985-d043bf78cecc\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"
Oct 30 22:07:29.132842 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:29.132756    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcg4t\" (UniqueName: \"kubernetes.io/projected/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc-kube-api-access-tcg4t\") pod \"payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj\" (UID: \"3dd9adb3-a2d7-4f2b-8985-d043bf78cecc\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"
Oct 30 22:07:29.133377 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:29.133348    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj\" (UID: \"3dd9adb3-a2d7-4f2b-8985-d043bf78cecc\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"
Oct 30 22:07:29.216666 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:29.215844    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcg4t\" (UniqueName: \"kubernetes.io/projected/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc-kube-api-access-tcg4t\") pod \"payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj\" (UID: \"3dd9adb3-a2d7-4f2b-8985-d043bf78cecc\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"
Oct 30 22:07:29.218890 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:29.218858    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"
Oct 30 22:07:29.527119 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:29.527040    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm" event={"ID":"aba4b2cc-918e-4a92-ba56-23066538cb59","Type":"ContainerStarted","Data":"39e2c28531926b16ca3b0b6d5c23abd3997028fe590481c3df55e516d07f8a6c"}
Oct 30 22:07:29.602764 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:29.597449    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"]
Oct 30 22:07:29.725060 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:07:29.725028    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd9adb3_a2d7_4f2b_8985_d043bf78cecc.slice/crio-01cdd8d6f7dc85a6750da4c4192732575316f97e65a8e3e7f86a41530bd915c2 WatchSource:0}: Error finding container 01cdd8d6f7dc85a6750da4c4192732575316f97e65a8e3e7f86a41530bd915c2: Status 404 returned error can't find the container with id 01cdd8d6f7dc85a6750da4c4192732575316f97e65a8e3e7f86a41530bd915c2
Oct 30 22:07:29.727537 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:29.727506    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"]
Oct 30 22:07:30.058614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:30.055767    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:07:30.058614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:30.055929    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:07:30.058614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:30.055975    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm" podUID="aba4b2cc-918e-4a92-ba56-23066538cb59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 22:07:30.534531 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:30.534494    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj" event={"ID":"3dd9adb3-a2d7-4f2b-8985-d043bf78cecc","Type":"ContainerStarted","Data":"e5b1c5a11b2870c20e2a699090d70729529212c86ec91de030bcf9739f165de6"}
Oct 30 22:07:30.534991 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:30.534550    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj" event={"ID":"3dd9adb3-a2d7-4f2b-8985-d043bf78cecc","Type":"ContainerStarted","Data":"01cdd8d6f7dc85a6750da4c4192732575316f97e65a8e3e7f86a41530bd915c2"}
Oct 30 22:07:30.534991 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:30.534578    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"
Oct 30 22:07:30.536908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:30.536883    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff" event={"ID":"1e670da5-3e9a-4d99-a5e6-d1251d5efcc7","Type":"ContainerStarted","Data":"f39ec6896fe849b7fddd0b31371c9a9edc6fd05a3102c902c40662c5c7eacd79"}
Oct 30 22:07:30.536999 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:30.536922    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff" event={"ID":"1e670da5-3e9a-4d99-a5e6-d1251d5efcc7","Type":"ContainerStarted","Data":"e1d93da595defc561151d8a2e203e907385d107d16bb0fe7b5fbbcefa12ae33e"}
Oct 30 22:07:30.536999 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:30.536943    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"
Oct 30 22:07:30.683613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:30.683148    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj" podStartSLOduration=2.683129078 podStartE2EDuration="2.683129078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:30.662057943 +0000 UTC m=+765.392915110" watchObservedRunningTime="2026-10-30 22:07:30.683129078 +0000 UTC m=+765.413986223"
Oct 30 22:07:31.060626 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:31.059969    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:07:31.060626 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:31.060045    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm" podUID="aba4b2cc-918e-4a92-ba56-23066538cb59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 22:07:31.114458 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:31.114202    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:31.275613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:31.274685    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:07:31.360676 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:31.358072    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:31.417265 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:31.417236    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"
Oct 30 22:07:31.547984 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:31.544532    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff" podStartSLOduration=3.544507821 podStartE2EDuration="3.544507821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:30.786363375 +0000 UTC m=+765.517220521" watchObservedRunningTime="2026-10-30 22:07:31.544507821 +0000 UTC m=+766.275364966"
Oct 30 22:07:31.615675 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:31.584112    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:32.058672 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:32.054965    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:07:32.058672 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:32.055032    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm" podUID="aba4b2cc-918e-4a92-ba56-23066538cb59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 22:07:33.054984 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:33.054946    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:07:33.055616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:33.055560    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm" podUID="aba4b2cc-918e-4a92-ba56-23066538cb59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 22:07:34.072615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:34.063971    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:07:34.072615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:34.064035    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm" podUID="aba4b2cc-918e-4a92-ba56-23066538cb59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 22:07:35.056296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:35.056258    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:07:35.057439 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:35.057412    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:07:35.443300 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:35.443213    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"
Oct 30 22:07:36.221791 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:36.221750    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:36.491127 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:36.491047    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:37.623771 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:37.623736    5258 generic.go:356] "Generic (PLEG): container finished" podID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerID="8c5ed8f60becddecce10e823a01fb98958d669d12669bf97f8103a4a1886082e" exitCode=0
Oct 30 22:07:37.624191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:37.623789    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2" event={"ID":"bad7c750-19d5-4dfd-b9d9-0a51e8696cad","Type":"ContainerDied","Data":"8c5ed8f60becddecce10e823a01fb98958d669d12669bf97f8103a4a1886082e"}
Oct 30 22:07:37.624191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:37.624126    5258 scope.go:122] "RemoveContainer" containerID="8c5ed8f60becddecce10e823a01fb98958d669d12669bf97f8103a4a1886082e"
Oct 30 22:07:37.625538 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:37.625515    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:37.625643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:37.625583    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:37.625643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:37.625630    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:38.501751 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:38.501719    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"
Oct 30 22:07:38.632190 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:38.632158    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2" event={"ID":"bad7c750-19d5-4dfd-b9d9-0a51e8696cad","Type":"ContainerStarted","Data":"81a5e794a61a8be7c9dc18e6f021d8a776424b9e06152b0ea9f03ab0ac47e13a"}
Oct 30 22:07:39.243723 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:39.243686    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:07:39.387963 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:39.387936    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:07:39.388149 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:39.388117    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 22:07:39.388225 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:39.388164    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2" podUID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 22:07:40.390612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:40.389933    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 22:07:40.390612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:40.389980    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2" podUID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 22:07:41.407541 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:41.407502    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:41.412714 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:41.407726    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 22:07:41.412959 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:41.412933    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2" podUID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 22:07:41.570979 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:41.570949    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"
Oct 30 22:07:41.578760 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:41.578732    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"
Oct 30 22:07:42.397612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:42.396654    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 22:07:42.397612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:42.396716    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2" podUID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 22:07:43.206076 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:07:43.206043    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:07:43.402301 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:43.401577    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 22:07:43.402301 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:43.401721    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2" podUID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 22:07:44.392195 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:44.392166    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:07:44.392737 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:44.392716    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:07:44.393492 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:44.393473    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:07:46.049596 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.049554    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"]
Oct 30 22:07:46.055264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.055225    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:46.108796 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.108769    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-963c3a-serving-cert\""
Oct 30 22:07:46.160929 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.160902    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"]
Oct 30 22:07:46.206971 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.206938    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57597cec-7e08-426c-ba3b-bda0d762f67e-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:46.207142 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.207017    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57597cec-7e08-426c-ba3b-bda0d762f67e-maas-api-tls\") pod \"maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:46.207142 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.207087    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9295k\" (UniqueName: \"kubernetes.io/projected/57597cec-7e08-426c-ba3b-bda0d762f67e-kube-api-access-9295k\") pod \"maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:46.207288 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.207213    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57597cec-7e08-426c-ba3b-bda0d762f67e-metrics-certs\") pod \"maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:46.308500 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.308463    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57597cec-7e08-426c-ba3b-bda0d762f67e-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:46.308708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.308563    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57597cec-7e08-426c-ba3b-bda0d762f67e-maas-api-tls\") pod \"maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:46.308708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.308617    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9295k\" (UniqueName: \"kubernetes.io/projected/57597cec-7e08-426c-ba3b-bda0d762f67e-kube-api-access-9295k\") pod \"maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:46.308802 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.308743    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57597cec-7e08-426c-ba3b-bda0d762f67e-metrics-certs\") pod \"maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:46.309164 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.309139    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57597cec-7e08-426c-ba3b-bda0d762f67e-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:46.311095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.311070    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57597cec-7e08-426c-ba3b-bda0d762f67e-maas-api-tls\") pod \"maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:46.311326 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.311308    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57597cec-7e08-426c-ba3b-bda0d762f67e-metrics-certs\") pod \"maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:46.318928 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.318901    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:46.374013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.373984    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9295k\" (UniqueName: \"kubernetes.io/projected/57597cec-7e08-426c-ba3b-bda0d762f67e-kube-api-access-9295k\") pod \"maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:46.545316 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.545279    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:46.668223 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:46.668130    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:47.060802 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:47.060773    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"]
Oct 30 22:07:47.061904 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:07:47.061872    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57597cec_7e08_426c_ba3b_bda0d762f67e.slice/crio-8c83f17e7306013fa5d8f5aaff3abe60b93a93246533fbdd8267e45e8012c506 WatchSource:0}: Error finding container 8c83f17e7306013fa5d8f5aaff3abe60b93a93246533fbdd8267e45e8012c506: Status 404 returned error can't find the container with id 8c83f17e7306013fa5d8f5aaff3abe60b93a93246533fbdd8267e45e8012c506
Oct 30 22:07:47.723411 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:47.723369    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch" event={"ID":"57597cec-7e08-426c-ba3b-bda0d762f67e","Type":"ContainerStarted","Data":"8c83f17e7306013fa5d8f5aaff3abe60b93a93246533fbdd8267e45e8012c506"}
Oct 30 22:07:48.172914 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:48.172878    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:07:48.321788 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:48.321747    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:07:48.322042 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:48.321841    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q" podUID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:07:48.731923 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:48.731826    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch" event={"ID":"57597cec-7e08-426c-ba3b-bda0d762f67e","Type":"ContainerStarted","Data":"bb032504eba159f62a70ae164cff4c39a4d5684a06b97ae875378031ccc3e144"}
Oct 30 22:07:48.732085 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:48.731942    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:48.850782 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:48.850724    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch" podStartSLOduration=2.01643035 podStartE2EDuration="2.850705242s" totalImagesPullingTime="834.274892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:48.849773261 +0000 UTC m=+783.580630408" watchObservedRunningTime="2026-10-30 22:07:48.850705242 +0000 UTC m=+783.581562386"
Oct 30 22:07:49.173442 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:49.173406    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:49.739266 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:49.739227    5258 generic.go:356] "Generic (PLEG): container finished" podID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerID="c5cba5d8ff1eb40d31cb19e4f4a7226c47128e0333a528ccacf23d1c816c1fd4" exitCode=0
Oct 30 22:07:49.739503 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:49.739293    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q" event={"ID":"d2dcd803-1841-4a81-a92c-0f9814962b94","Type":"ContainerDied","Data":"c5cba5d8ff1eb40d31cb19e4f4a7226c47128e0333a528ccacf23d1c816c1fd4"}
Oct 30 22:07:49.739848 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:49.739828    5258 scope.go:122] "RemoveContainer" containerID="c5cba5d8ff1eb40d31cb19e4f4a7226c47128e0333a528ccacf23d1c816c1fd4"
Oct 30 22:07:49.741066 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:49.741040    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:49.741149 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:49.741106    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:49.741149 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:49.741138    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:49.788925 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:49.788904    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:50.024228 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:50.024132    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:50.780617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:50.772430    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q" event={"ID":"d2dcd803-1841-4a81-a92c-0f9814962b94","Type":"ContainerStarted","Data":"6ba8970c1bf50fee275e620b8c5008871dda72a74f78b7af82d6dbb4883f7512"}
Oct 30 22:07:51.709711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:51.709677    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:07:51.709961 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:51.709938    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:07:51.710053 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:51.709991    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q" podUID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 22:07:52.035004 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:52.034925    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:52.262260 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:52.262227    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:52.543273 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:52.543238    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:52.709773 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:52.709739    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:07:52.709948 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:52.709791    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q" podUID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 22:07:53.710358 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:53.710318    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:07:53.710788 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:53.710372    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q" podUID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 22:07:53.887809 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:53.886383    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:54.710118 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:54.710064    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:07:54.710334 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:54.710150    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q" podUID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 22:07:54.744986 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:54.744959    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:07:55.709621 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:55.709571    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:07:55.709816 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:55.709655    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q" podUID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 22:07:56.747250 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:56.747205    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:07:56.748231 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:56.748205    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:07:56.749264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:56.749245    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:07:57.470143 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:07:57.470089    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:02.610377 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:02.610331    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:03.593098 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:03.593064    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:04.219416 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:04.219380    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:04.496697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:04.496617    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:07.912076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:07.912036    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:08:08.013783 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:08.013746    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:12.870334 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:12.870297    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:13.160947 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:08:13.160856    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:08:13.291431 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:13.291398    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:13.536125 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:13.536046    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:13.771685 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:13.771632    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:18.382272 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.382235    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:18.653917 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.653840    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"]
Oct 30 22:08:18.657818 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.657797    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.717574 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.717545    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz94t\" (UniqueName: \"kubernetes.io/projected/1df49718-8a53-4773-a510-555ee7c50f27-kube-api-access-hz94t\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.717777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.717616    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1df49718-8a53-4773-a510-555ee7c50f27-tls-certs\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.717777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.717642    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-dshm\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.717891 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.717794    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-home\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.717891 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.717838    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-model-cache\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.718000 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.717907    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-tmp-dir\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.759976 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.759939    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-77cb1f\"/\"openshift-service-ca.crt\""
Oct 30 22:08:18.760162 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.759985    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-77cb1f\"/\"simulator-w1-77cb1f-kserve-self-signed-certs\""
Oct 30 22:08:18.760162 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.760099    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-77cb1f\"/\"kube-root-ca.crt\""
Oct 30 22:08:18.760162 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.760100    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-77cb1f\"/\"default-dockercfg-4sfbv\""
Oct 30 22:08:18.763510 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.763489    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"]
Oct 30 22:08:18.819005 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.818975    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz94t\" (UniqueName: \"kubernetes.io/projected/1df49718-8a53-4773-a510-555ee7c50f27-kube-api-access-hz94t\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.819194 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.819023    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1df49718-8a53-4773-a510-555ee7c50f27-tls-certs\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.819194 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.819043    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-dshm\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.819194 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.819092    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-home\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.819194 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.819119    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-model-cache\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.819194 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.819142    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-tmp-dir\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.819605 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.819565    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-tmp-dir\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.819755 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.819651    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-model-cache\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.819755 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.819692    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-home\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.821262 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.821243    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-dshm\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.821707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.821688    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1df49718-8a53-4773-a510-555ee7c50f27-tls-certs\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.824254 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.824220    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:18.883398 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.883372    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz94t\" (UniqueName: \"kubernetes.io/projected/1df49718-8a53-4773-a510-555ee7c50f27-kube-api-access-hz94t\") pod \"simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") " pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:18.971282 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:18.971203    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:19.356615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:19.356561    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"]
Oct 30 22:08:19.357043 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:08:19.357018    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1df49718_8a53_4773_a510_555ee7c50f27.slice/crio-9d3eb8e69ab6ee52674bf6da4f80c2e3fd4f0a46fda5cb9b1bd321abfbe044e2 WatchSource:0}: Error finding container 9d3eb8e69ab6ee52674bf6da4f80c2e3fd4f0a46fda5cb9b1bd321abfbe044e2: Status 404 returned error can't find the container with id 9d3eb8e69ab6ee52674bf6da4f80c2e3fd4f0a46fda5cb9b1bd321abfbe044e2
Oct 30 22:08:19.760636 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:19.760577    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:19.965366 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:19.965270    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" event={"ID":"1df49718-8a53-4773-a510-555ee7c50f27","Type":"ContainerStarted","Data":"1553de21b422482888701c6338cc1c6411ff2f2864042d114199b71b7b20522b"}
Oct 30 22:08:19.965366 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:19.965327    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" event={"ID":"1df49718-8a53-4773-a510-555ee7c50f27","Type":"ContainerStarted","Data":"9d3eb8e69ab6ee52674bf6da4f80c2e3fd4f0a46fda5cb9b1bd321abfbe044e2"}
Oct 30 22:08:19.971516 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:19.971492    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:20.083517 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:20.083465    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podStartSLOduration=2.083447789 podStartE2EDuration="2.083447789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:20.082502454 +0000 UTC m=+814.813359597" watchObservedRunningTime="2026-10-30 22:08:20.083447789 +0000 UTC m=+814.814304933"
Oct 30 22:08:23.262577 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:23.262531    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:23.805796 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:23.805762    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:24.029190 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:24.029160    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:24.252963 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:24.252924    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:25.336031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:25.335999    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:25.989175 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:25.989140    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:26.237386 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:26.237349    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:26.870725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:26.870687    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:08:28.972018 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:28.971983    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:28.984775 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:28.984750    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:29.042681 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:29.042659    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:08:29.098712 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:29.098681    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:31.026723 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.026689    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"]
Oct 30 22:08:31.030438 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.030421    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.132499 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.132468    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-075cbb\"/\"openshift-service-ca.crt\""
Oct 30 22:08:31.132499 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.132468    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-075cbb\"/\"default-dockercfg-dzqtz\""
Oct 30 22:08:31.132499 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.132499    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-075cbb\"/\"simulator-w5-075cbb-kserve-self-signed-certs\""
Oct 30 22:08:31.132865 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.132846    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-075cbb\"/\"kube-root-ca.crt\""
Oct 30 22:08:31.135738 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.135719    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"]
Oct 30 22:08:31.148016 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.147993    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-tmp-dir\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.148109 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.148023    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-model-cache\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.148109 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.148040    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-dshm\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.148190 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.148172    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-home\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.148265 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.148253    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa100c4d-158f-4995-b648-b5524aa575b5-tls-certs\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.148300 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.148286    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5hcv\" (UniqueName: \"kubernetes.io/projected/fa100c4d-158f-4995-b648-b5524aa575b5-kube-api-access-z5hcv\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.180719 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.180680    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:31.249255 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.249224    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-tmp-dir\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.249255 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.249256    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-model-cache\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.249472 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.249274    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-dshm\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.249472 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.249308    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-home\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.249472 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.249425    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa100c4d-158f-4995-b648-b5524aa575b5-tls-certs\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.249665 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.249473    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hcv\" (UniqueName: \"kubernetes.io/projected/fa100c4d-158f-4995-b648-b5524aa575b5-kube-api-access-z5hcv\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.249740 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.249714    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-tmp-dir\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.249832 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.249806    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-model-cache\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.249832 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.249826    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-home\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.251610 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.251578    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-dshm\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.251898 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.251883    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa100c4d-158f-4995-b648-b5524aa575b5-tls-certs\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.311186 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.311162    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5hcv\" (UniqueName: \"kubernetes.io/projected/fa100c4d-158f-4995-b648-b5524aa575b5-kube-api-access-z5hcv\") pod \"simulator-w5-075cbb-kserve-74d46db6cf-922nk\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") " pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.343736 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.343716    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:31.730939 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:31.730911    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"]
Oct 30 22:08:31.733042 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:08:31.733003    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa100c4d_158f_4995_b648_b5524aa575b5.slice/crio-33719a3dec98db29e973ad44acdbb1229e216a50ac8a17b7ec8a1c462ff90c1f WatchSource:0}: Error finding container 33719a3dec98db29e973ad44acdbb1229e216a50ac8a17b7ec8a1c462ff90c1f: Status 404 returned error can't find the container with id 33719a3dec98db29e973ad44acdbb1229e216a50ac8a17b7ec8a1c462ff90c1f
Oct 30 22:08:32.053449 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:32.053370    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" event={"ID":"fa100c4d-158f-4995-b648-b5524aa575b5","Type":"ContainerStarted","Data":"4afc0191771c604ae4f42369e46a2cdbe8973bd1ce214e50143877b79c5e57d3"}
Oct 30 22:08:32.053449 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:32.053412    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" event={"ID":"fa100c4d-158f-4995-b648-b5524aa575b5","Type":"ContainerStarted","Data":"33719a3dec98db29e973ad44acdbb1229e216a50ac8a17b7ec8a1c462ff90c1f"}
Oct 30 22:08:32.173869 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:32.173821    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podStartSLOduration=2.173805972 podStartE2EDuration="2.173805972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:32.170920352 +0000 UTC m=+826.901777492" watchObservedRunningTime="2026-10-30 22:08:32.173805972 +0000 UTC m=+826.904663115"
Oct 30 22:08:32.344327 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:32.344294    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:34.197205 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:34.197167    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:36.261837 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:36.261799    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:36.891147 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:36.891082    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:37.121233 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:37.121194    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:39.528095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:39.528061    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:41.344829 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:41.344789    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:41.357409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:41.357388    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:41.581461 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:41.581424    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:42.130571 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:42.130539    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:08:42.279066 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:42.279036    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:42.514429 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:42.514338    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:43.161095 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:08:43.161062    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:08:44.771696 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:44.771661    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:46.860285 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:46.860252    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:08:48.018384 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:48.018346    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:49.787304 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:49.787268    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:51.433041 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:51.433004    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:54.885711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:54.885671    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:59.981803 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:08:59.981761    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:02.810438 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:02.810398    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:05.024777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:05.024745    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:09.944397 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:09.944359    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:09:10.137608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:10.137411    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:11.243777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.243746    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"]
Oct 30 22:09:11.247784 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.247767    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.350448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.350414    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-963c3a\"/\"kube-root-ca.crt\""
Oct 30 22:09:11.350448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.350453    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-963c3a\"/\"openshift-service-ca.crt\""
Oct 30 22:09:11.350739 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.350653    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-963c3a\"/\"simulator-w3-963c3a-kserve-self-signed-certs\""
Oct 30 22:09:11.350739 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.350688    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-963c3a\"/\"default-dockercfg-54nv5\""
Oct 30 22:09:11.354911 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.354880    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"]
Oct 30 22:09:11.378581 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.378558    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-tmp-dir\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.378880 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.378840    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-model-cache\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.379305 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.378949    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-home\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.379305 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.378990    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/959a5d75-a7e2-4767-873d-6cd573c1bbd7-tls-certs\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.379305 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.379034    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-dshm\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.379305 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.379064    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqwfx\" (UniqueName: \"kubernetes.io/projected/959a5d75-a7e2-4767-873d-6cd573c1bbd7-kube-api-access-pqwfx\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.490425 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.490390    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-tmp-dir\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.490629 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.490456    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-model-cache\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.490629 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.490512    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-home\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.490629 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.490546    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/959a5d75-a7e2-4767-873d-6cd573c1bbd7-tls-certs\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.490629 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.490615    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-dshm\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.490861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.490646    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqwfx\" (UniqueName: \"kubernetes.io/projected/959a5d75-a7e2-4767-873d-6cd573c1bbd7-kube-api-access-pqwfx\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.490861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.490841    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-tmp-dir\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.490994 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.490938    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-model-cache\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.490994 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.490969    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-home\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.492843 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.492816    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-dshm\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.493142 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.493123    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/959a5d75-a7e2-4767-873d-6cd573c1bbd7-tls-certs\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.552809 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.552749    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqwfx\" (UniqueName: \"kubernetes.io/projected/959a5d75-a7e2-4767-873d-6cd573c1bbd7-kube-api-access-pqwfx\") pod \"simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") " pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.559292 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.559272    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:11.938568 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:11.938541    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"]
Oct 30 22:09:11.940705 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:09:11.940682    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod959a5d75_a7e2_4767_873d_6cd573c1bbd7.slice/crio-f8f81f6ffa11218547efd29ec449ab138a7d901dad0fd3436ca73fb545975c9a WatchSource:0}: Error finding container f8f81f6ffa11218547efd29ec449ab138a7d901dad0fd3436ca73fb545975c9a: Status 404 returned error can't find the container with id f8f81f6ffa11218547efd29ec449ab138a7d901dad0fd3436ca73fb545975c9a
Oct 30 22:09:12.037543 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:12.037505    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:12.309655 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:12.309626    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" event={"ID":"959a5d75-a7e2-4767-873d-6cd573c1bbd7","Type":"ContainerStarted","Data":"990e1ead2ab39eca18d8719229ce5b1365d7e5dd83f9ab3243f691f38180a3be"}
Oct 30 22:09:12.310031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:12.309670    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" event={"ID":"959a5d75-a7e2-4767-873d-6cd573c1bbd7","Type":"ContainerStarted","Data":"f8f81f6ffa11218547efd29ec449ab138a7d901dad0fd3436ca73fb545975c9a"}
Oct 30 22:09:12.429091 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:12.429041    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podStartSLOduration=1.429026348 podStartE2EDuration="1.429026348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:09:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:09:12.427695803 +0000 UTC m=+867.158552947" watchObservedRunningTime="2026-10-30 22:09:12.429026348 +0000 UTC m=+867.159883492"
Oct 30 22:09:12.560012 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:12.559936    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:13.161106 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:09:13.161070    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:09:15.213213 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:15.213166    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:20.100368 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:20.100330    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:20.322434 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:20.322398    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:21.559534 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:21.559502    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:21.572359 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:21.572326    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:22.032223 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:22.032129    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:22.383702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:22.383670    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:09:25.383726 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:25.383692    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:26.230854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:26.230808    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:27.529954 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:27.529920    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:09:30.431161 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:30.431123    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:35.597388 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:35.597344    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:40.712464 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:40.712425    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:41.676084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.676048    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"]
Oct 30 22:09:41.680521 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.680500    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.737516 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.737486    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"]
Oct 30 22:09:41.780099 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.780051    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:41.783205 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.783178    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-77cb1f\"/\"premium-w1-77cb1f-kserve-self-signed-certs\""
Oct 30 22:09:41.826784 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.826740    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-tmp-dir\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.826941 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.826908    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsphx\" (UniqueName: \"kubernetes.io/projected/e518f67a-3d86-4c6f-8940-9da1d76ac85e-kube-api-access-rsphx\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.827001 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.826946    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-dshm\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.827001 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.826969    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e518f67a-3d86-4c6f-8940-9da1d76ac85e-tls-certs\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.827116 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.827096    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-home\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.827168 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.827154    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-model-cache\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.928361 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.928282    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-tmp-dir\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.928521 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.928368    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsphx\" (UniqueName: \"kubernetes.io/projected/e518f67a-3d86-4c6f-8940-9da1d76ac85e-kube-api-access-rsphx\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.928521 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.928395    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-dshm\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.928521 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.928412    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e518f67a-3d86-4c6f-8940-9da1d76ac85e-tls-certs\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.928521 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.928432    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-home\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.928521 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.928504    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-model-cache\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.928822 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.928802    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-tmp-dir\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.928881 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.928867    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-home\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.928970 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.928951    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-model-cache\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.930789 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.930767    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-dshm\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:41.930951 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:41.930931    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e518f67a-3d86-4c6f-8940-9da1d76ac85e-tls-certs\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:42.006204 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:42.006173    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsphx\" (UniqueName: \"kubernetes.io/projected/e518f67a-3d86-4c6f-8940-9da1d76ac85e-kube-api-access-rsphx\") pod \"premium-w1-77cb1f-kserve-745d4f4465-pg2j4\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") " pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:42.293347 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:42.293275    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:42.675697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:42.675663    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"]
Oct 30 22:09:42.678715 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:09:42.678681    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode518f67a_3d86_4c6f_8940_9da1d76ac85e.slice/crio-1ec72fd3e5540516f236165a96f6042615288bab7faa6e367dd1333bf2f5f622 WatchSource:0}: Error finding container 1ec72fd3e5540516f236165a96f6042615288bab7faa6e367dd1333bf2f5f622: Status 404 returned error can't find the container with id 1ec72fd3e5540516f236165a96f6042615288bab7faa6e367dd1333bf2f5f622
Oct 30 22:09:43.161178 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:09:43.161143    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:09:43.520221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:43.520138    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" event={"ID":"e518f67a-3d86-4c6f-8940-9da1d76ac85e","Type":"ContainerStarted","Data":"5ebb0760f863cb8fc940abb4da98a5a3154d6795867a575a857cd76771ac1ec5"}
Oct 30 22:09:43.520221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:43.520174    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" event={"ID":"e518f67a-3d86-4c6f-8940-9da1d76ac85e","Type":"ContainerStarted","Data":"1ec72fd3e5540516f236165a96f6042615288bab7faa6e367dd1333bf2f5f622"}
Oct 30 22:09:43.673711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:43.673661    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podStartSLOduration=2.673647757 podStartE2EDuration="2.673647757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:09:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:09:43.671307946 +0000 UTC m=+898.402165091" watchObservedRunningTime="2026-10-30 22:09:43.673647757 +0000 UTC m=+898.404504900"
Oct 30 22:09:44.293684 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:44.293648    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:45.468564 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:45.468527    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:09:45.472256 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:45.472232    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:09:45.801011 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:45.800924    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:47.884767 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:47.884729    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:09:51.046873 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:51.046838    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:52.294305 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:52.294275    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:52.307271 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:52.307250    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:52.602170 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:52.602138    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:09:56.144173 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:56.144094    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:56.575223 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:56.575191    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:59.926218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:09:59.926182    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:01.086077 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:01.086039    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:06.080694 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:06.080657    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:09.448712 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:09.448670    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:11.181673 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:11.181638    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:13.164539 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:10:13.164495    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:10:15.635287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:15.635253    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:10:16.338158 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:16.338121    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:20.482674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:20.482636    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:21.251405 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:21.251372    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:21.547065 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:21.546979    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:26.644201 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:26.644168    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:31.708516 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:31.708479    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:36.681913 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:36.681878    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:37.004295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.004218    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"]
Oct 30 22:10:37.010695 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.010664    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.067956 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.067925    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"]
Oct 30 22:10:37.113654 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.113611    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-2a4123\"/\"premium-w0-2a4123-kserve-self-signed-certs\""
Oct 30 22:10:37.113654 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.113614    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-2a4123\"/\"openshift-service-ca.crt\""
Oct 30 22:10:37.113654 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.113620    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-2a4123\"/\"default-dockercfg-snr45\""
Oct 30 22:10:37.114139 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.114117    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-2a4123\"/\"kube-root-ca.crt\""
Oct 30 22:10:37.179562 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.179521    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:37.185420 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.185395    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c00f4f-9fae-4aac-acf3-335d0055b534-tls-certs\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.185574 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.185427    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsl8d\" (UniqueName: \"kubernetes.io/projected/39c00f4f-9fae-4aac-acf3-335d0055b534-kube-api-access-dsl8d\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.185574 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.185460    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-dshm\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.185711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.185620    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-tmp-dir\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.185760 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.185739    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-model-cache\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.185802 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.185790    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-home\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.287320 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.287237    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c00f4f-9fae-4aac-acf3-335d0055b534-tls-certs\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.287320 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.287287    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsl8d\" (UniqueName: \"kubernetes.io/projected/39c00f4f-9fae-4aac-acf3-335d0055b534-kube-api-access-dsl8d\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.287558 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.287343    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-dshm\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.287558 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.287403    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-tmp-dir\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.287558 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.287483    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-model-cache\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.287558 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.287540    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-home\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.287934 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.287910    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-tmp-dir\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.288011 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.287932    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-model-cache\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.288070 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.288018    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-home\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.289741 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.289719    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-dshm\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.289927 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.289910    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c00f4f-9fae-4aac-acf3-335d0055b534-tls-certs\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.349290 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.349263    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsl8d\" (UniqueName: \"kubernetes.io/projected/39c00f4f-9fae-4aac-acf3-335d0055b534-kube-api-access-dsl8d\") pod \"premium-w0-2a4123-kserve-5d84665997-ql2s9\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") " pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:37.625240 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:37.625204    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:38.015210 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:38.015184    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"]
Oct 30 22:10:38.017196 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:10:38.017169    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39c00f4f_9fae_4aac_acf3_335d0055b534.slice/crio-ba2dceb3cf0a81fb59fe31727c3c9bc53264343dfe59071ac85bcf7419ca61f5 WatchSource:0}: Error finding container ba2dceb3cf0a81fb59fe31727c3c9bc53264343dfe59071ac85bcf7419ca61f5: Status 404 returned error can't find the container with id ba2dceb3cf0a81fb59fe31727c3c9bc53264343dfe59071ac85bcf7419ca61f5
Oct 30 22:10:38.900641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:38.900584    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" event={"ID":"39c00f4f-9fae-4aac-acf3-335d0055b534","Type":"ContainerStarted","Data":"0c4a441e0db8b8469331c946736b99f39433a0afe6ae222e302e560b59a869b9"}
Oct 30 22:10:38.900641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:38.900647    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" event={"ID":"39c00f4f-9fae-4aac-acf3-335d0055b534","Type":"ContainerStarted","Data":"ba2dceb3cf0a81fb59fe31727c3c9bc53264343dfe59071ac85bcf7419ca61f5"}
Oct 30 22:10:39.024055 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:39.024003    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podStartSLOduration=3.023988237 podStartE2EDuration="3.023988237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:39.021396063 +0000 UTC m=+953.752253210" watchObservedRunningTime="2026-10-30 22:10:39.023988237 +0000 UTC m=+953.754845381"
Oct 30 22:10:39.625920 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:39.625889    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:41.798369 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:41.798332    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:43.164186 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:10:43.164136    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:10:46.875100 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:46.875062    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:46.985659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:46.985610    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:10:47.625635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:47.625600    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:47.638802 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:47.638768    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:47.975067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:47.974972    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:10:48.079654 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:48.079625    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:51.958754 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:51.958342    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:52.179504 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:52.179471    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:53.066044 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:53.066006    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:57.073699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:10:57.073655    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:02.234975 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:02.234931    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:07.341978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:07.341945    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:12.302985 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:12.302939    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:13.163171 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:11:13.163131    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:11:15.955111 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:15.955078    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"]
Oct 30 22:11:15.959275 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:15.959251    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.065086 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.065057    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"]
Oct 30 22:11:16.137786 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.137757    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-data\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.137931 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.137807    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-podinfo\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.137931 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.137892    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-envoy\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.138033 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.137931    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebee4cde-8248-44a5-bba0-c6321764dec0-istiod-ca-cert\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.138033 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.137956    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-workload-certs\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.138150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.138092    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-token\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.138150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.138130    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzhs7\" (UniqueName: \"kubernetes.io/projected/ebee4cde-8248-44a5-bba0-c6321764dec0-kube-api-access-dzhs7\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.138256 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.138236    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-workload-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.138328 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.138310    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-credential-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.219534 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.219470    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"]
Oct 30 22:11:16.224071 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.224049    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.239815 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.239793    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-token\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.239918 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.239820    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzhs7\" (UniqueName: \"kubernetes.io/projected/ebee4cde-8248-44a5-bba0-c6321764dec0-kube-api-access-dzhs7\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.239918 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.239857    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-workload-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.239918 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.239908    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-credential-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.240029 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.239966    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-data\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.240094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.240025    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-podinfo\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.240153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.240131    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-envoy\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.240208 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.240196    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebee4cde-8248-44a5-bba0-c6321764dec0-istiod-ca-cert\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.240261 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.240243    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-workload-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.240323 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.240285    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-workload-certs\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.240323 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.240297    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-credential-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.240432 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.240411    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-data\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.240555 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.240536    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-workload-certs\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.240814 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.240796    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebee4cde-8248-44a5-bba0-c6321764dec0-istiod-ca-cert\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.242334 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.242313    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-envoy\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.242553 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.242531    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-podinfo\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.277103 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.277086    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-075cbb-openshift-default-dockercfg-88pqw\""
Oct 30 22:11:16.283672 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.283640    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"]
Oct 30 22:11:16.301679 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.301660    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-token\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.301823 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.301734    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzhs7\" (UniqueName: \"kubernetes.io/projected/ebee4cde-8248-44a5-bba0-c6321764dec0-kube-api-access-dzhs7\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.340825 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.340802    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-workload-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.340937 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.340834    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-credential-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.340937 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.340859    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-envoy\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.341010 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.340929    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8qb2\" (UniqueName: \"kubernetes.io/projected/0c2299dc-d499-44f2-ba4f-710d84de4bed-kube-api-access-p8qb2\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.341062 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.341044    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-data\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.341099 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.341079    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c2299dc-d499-44f2-ba4f-710d84de4bed-istiod-ca-cert\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.341178 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.341167    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-workload-certs\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.341230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.341217    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-podinfo\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.341267 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.341240    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-token\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.441979 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.441954    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-workload-certs\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.442115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.441986    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-podinfo\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.442115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.442004    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-token\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.442115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.442026    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-workload-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.442115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.442053    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-credential-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.442115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.442097    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-envoy\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.442402 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.442125    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8qb2\" (UniqueName: \"kubernetes.io/projected/0c2299dc-d499-44f2-ba4f-710d84de4bed-kube-api-access-p8qb2\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.442402 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.442222    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-data\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.442402 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.442260    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c2299dc-d499-44f2-ba4f-710d84de4bed-istiod-ca-cert\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.442402 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.442376    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-workload-certs\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.442640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.442421    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-workload-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.442640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.442477    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-credential-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.442718 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.442649    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-data\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.443056 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.443033    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c2299dc-d499-44f2-ba4f-710d84de4bed-istiod-ca-cert\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.444300 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.444280    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-envoy\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.444517 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.444500    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-podinfo\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.503669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.503585    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-token\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.503841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.503819    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8qb2\" (UniqueName: \"kubernetes.io/projected/0c2299dc-d499-44f2-ba4f-710d84de4bed-kube-api-access-p8qb2\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.538168 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.538145    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:16.573486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.573462    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:16.960298 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.960269    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"]
Oct 30 22:11:16.965260 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.965241    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:16.976984 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.976944    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"]
Oct 30 22:11:16.979531 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:11:16.979508    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebee4cde_8248_44a5_bba0_c6321764dec0.slice/crio-5cf8a8f63437966f5cead063d317b0de14b60f370bedb29f6d1af7ce1f40fe10 WatchSource:0}: Error finding container 5cf8a8f63437966f5cead063d317b0de14b60f370bedb29f6d1af7ce1f40fe10: Status 404 returned error can't find the container with id 5cf8a8f63437966f5cead063d317b0de14b60f370bedb29f6d1af7ce1f40fe10
Oct 30 22:11:16.981022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.980998    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"]
Oct 30 22:11:16.982543 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.982516    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:11:16.982650 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.982571    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:11:16.982694 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:16.982659    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:11:17.012820 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:11:17.012795    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c2299dc_d499_44f2_ba4f_710d84de4bed.slice/crio-79e67b4e82b66862d72361e2b91ddba1fcc7bd42a7af7be28bc1d3ad6e328afc WatchSource:0}: Error finding container 79e67b4e82b66862d72361e2b91ddba1fcc7bd42a7af7be28bc1d3ad6e328afc: Status 404 returned error can't find the container with id 79e67b4e82b66862d72361e2b91ddba1fcc7bd42a7af7be28bc1d3ad6e328afc
Oct 30 22:11:17.015220 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.015192    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:11:17.015291 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.015254    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:11:17.015291 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.015283    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:11:17.017752 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.017729    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-97aa64-openshift-default-dockercfg-dhxrl\""
Oct 30 22:11:17.050212 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.050189    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-workload-certs\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.050338 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.050226    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dpdm\" (UniqueName: \"kubernetes.io/projected/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-kube-api-access-2dpdm\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.050338 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.050258    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-workload-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.050338 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.050296    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-credential-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.050514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.050369    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istiod-ca-cert\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.050514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.050401    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-envoy\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.050514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.050422    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-podinfo\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.050514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.050462    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-token\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.050514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.050495    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-data\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.082411 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.071859    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"]
Oct 30 22:11:17.151306 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.151273    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-data\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.151552 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.151537    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-workload-certs\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.151703 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.151655    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dpdm\" (UniqueName: \"kubernetes.io/projected/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-kube-api-access-2dpdm\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.151854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.151836    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-workload-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.151979 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.151963    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-credential-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.152133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.152116    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istiod-ca-cert\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.152286 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.152270    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-envoy\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.152412 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.152397    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-podinfo\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.152565 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.152550    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-token\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.152748 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.151906    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-workload-certs\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.153128 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.153100    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istiod-ca-cert\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.153218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.151714    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-data\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.153218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.152451    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-credential-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.153627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.153584    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-workload-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.156232 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.156172    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-podinfo\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.156427 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.156411    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-envoy\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.174573 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.174481    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj" event={"ID":"ebee4cde-8248-44a5-bba0-c6321764dec0","Type":"ContainerStarted","Data":"4d9069551aabaa09fb4ca520029ac6a4d807ea58e051026e23812869e7b9ecc3"}
Oct 30 22:11:17.174573 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.174542    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj" event={"ID":"ebee4cde-8248-44a5-bba0-c6321764dec0","Type":"ContainerStarted","Data":"5cf8a8f63437966f5cead063d317b0de14b60f370bedb29f6d1af7ce1f40fe10"}
Oct 30 22:11:17.176759 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.176740    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw" event={"ID":"0c2299dc-d499-44f2-ba4f-710d84de4bed","Type":"ContainerStarted","Data":"bb0330d465eacaead77e7112848773f80836c19ed9d892e2eb134d51d501b6a1"}
Oct 30 22:11:17.176948 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.176933    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw" event={"ID":"0c2299dc-d499-44f2-ba4f-710d84de4bed","Type":"ContainerStarted","Data":"79e67b4e82b66862d72361e2b91ddba1fcc7bd42a7af7be28bc1d3ad6e328afc"}
Oct 30 22:11:17.213785 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.213723    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dpdm\" (UniqueName: \"kubernetes.io/projected/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-kube-api-access-2dpdm\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.214578 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.214561    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-token\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.285398 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.281120    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:17.304536 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.304486    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj" podStartSLOduration=2.3044675789999998 podStartE2EDuration="2.304467579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:11:17.299390193 +0000 UTC m=+992.030247337" watchObservedRunningTime="2026-10-30 22:11:17.304467579 +0000 UTC m=+992.035324721"
Oct 30 22:11:17.396743 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.396697    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:17.432249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.432182    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw" podStartSLOduration=1.432161856 podStartE2EDuration="1.432161856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:11:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:11:17.430630541 +0000 UTC m=+992.161487685" watchObservedRunningTime="2026-10-30 22:11:17.432161856 +0000 UTC m=+992.163019000"
Oct 30 22:11:17.538821 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.538634    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:17.574036 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.574000    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:17.723321 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:11:17.723247    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eb38bdf_2e27_4229_9670_dc3230d6e7fd.slice/crio-3c0840e629ec2e1e87439758f865bdaada5f62c7f4510d44655f91ed6b5dbcdb WatchSource:0}: Error finding container 3c0840e629ec2e1e87439758f865bdaada5f62c7f4510d44655f91ed6b5dbcdb: Status 404 returned error can't find the container with id 3c0840e629ec2e1e87439758f865bdaada5f62c7f4510d44655f91ed6b5dbcdb
Oct 30 22:11:17.723954 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.723931    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"]
Oct 30 22:11:17.726286 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.726247    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:11:17.726360 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.726333    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:11:17.726412 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:17.726376    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:11:18.220488 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:18.220458    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8" event={"ID":"1eb38bdf-2e27-4229-9670-dc3230d6e7fd","Type":"ContainerStarted","Data":"9501f98c1948762a4d7ac8cfc4d3f7edab271d69e7a699aaca1f2228f7366efd"}
Oct 30 22:11:18.220966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:18.220946    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8" event={"ID":"1eb38bdf-2e27-4229-9670-dc3230d6e7fd","Type":"ContainerStarted","Data":"3c0840e629ec2e1e87439758f865bdaada5f62c7f4510d44655f91ed6b5dbcdb"}
Oct 30 22:11:18.300615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:18.299823    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"]
Oct 30 22:11:18.300615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:18.300064    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg" podUID="35018678-433d-44e0-9188-4896dcd42d86" containerName="istio-proxy" containerID="cri-o://4c9df31cd1eb2d48a5b79d6e674f094ef34efa3582c1ddedeaa626a8721e8e25" gracePeriod=30
Oct 30 22:11:18.302496 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:18.302473    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:18.312779 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:18.312147    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:11:18.312779 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:18.312213    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8" podUID="1eb38bdf-2e27-4229-9670-dc3230d6e7fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:11:18.437874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:18.437803    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8" podStartSLOduration=2.437783017 podStartE2EDuration="2.437783017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:11:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:11:18.431956086 +0000 UTC m=+993.162813231" watchObservedRunningTime="2026-10-30 22:11:18.437783017 +0000 UTC m=+993.168640160"
Oct 30 22:11:18.540207 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:18.540126    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:11:18.540339 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:18.540218    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw" podUID="0c2299dc-d499-44f2-ba4f-710d84de4bed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 22:11:18.580131 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:18.580015    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:11:18.580131 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:18.580072    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj" podUID="ebee4cde-8248-44a5-bba0-c6321764dec0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 22:11:19.303612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:19.303007    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:11:19.303612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:19.303089    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8" podUID="1eb38bdf-2e27-4229-9670-dc3230d6e7fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:11:19.539317 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:19.539280    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:11:19.539561 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:19.539537    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw" podUID="0c2299dc-d499-44f2-ba4f-710d84de4bed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 22:11:19.587887 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:19.587853    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:11:19.588861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:19.588829    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj" podUID="ebee4cde-8248-44a5-bba0-c6321764dec0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 22:11:20.282017 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:20.281978    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:11:20.282326 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:20.282293    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8" podUID="1eb38bdf-2e27-4229-9670-dc3230d6e7fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:11:20.540672 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:20.540219    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:11:20.540672 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:20.540286    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw" podUID="0c2299dc-d499-44f2-ba4f-710d84de4bed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 22:11:20.597614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:20.593667    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:11:20.597614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:20.593727    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj" podUID="ebee4cde-8248-44a5-bba0-c6321764dec0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 22:11:20.979746 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:20.979182    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:21.292671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:21.281965    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:11:21.292671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:21.282025    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8" podUID="1eb38bdf-2e27-4229-9670-dc3230d6e7fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:11:21.539358 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:21.539317    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:11:21.539631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:21.539577    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw" podUID="0c2299dc-d499-44f2-ba4f-710d84de4bed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 22:11:21.597616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:21.577291    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:11:21.597616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:21.577350    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj" podUID="ebee4cde-8248-44a5-bba0-c6321764dec0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 22:11:22.285615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:22.285287    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:11:22.285615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:22.285368    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8" podUID="1eb38bdf-2e27-4229-9670-dc3230d6e7fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:11:22.539671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:22.539556    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:11:22.539840 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:22.539724    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw" podUID="0c2299dc-d499-44f2-ba4f-710d84de4bed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 22:11:22.577614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:22.577271    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:11:22.577614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:22.577422    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj" podUID="ebee4cde-8248-44a5-bba0-c6321764dec0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 22:11:22.609643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:22.609397    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:23.282614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:23.281953    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:11:23.282614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:23.282016    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8" podUID="1eb38bdf-2e27-4229-9670-dc3230d6e7fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:11:23.539092 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:23.539008    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:11:23.539092 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:23.539068    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw" podUID="0c2299dc-d499-44f2-ba4f-710d84de4bed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 22:11:23.577613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:23.576855    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:11:23.577613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:23.576914    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj" podUID="ebee4cde-8248-44a5-bba0-c6321764dec0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 22:11:24.283612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.282039    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:11:24.283612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.282110    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8" podUID="1eb38bdf-2e27-4229-9670-dc3230d6e7fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:11:24.293711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.292692    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:11:24.326192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.326152    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/35018678-433d-44e0-9188-4896dcd42d86-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35018678-433d-44e0-9188-4896dcd42d86-istiod-ca-cert\") pod \"35018678-433d-44e0-9188-4896dcd42d86\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") "
Oct 30 22:11:24.326192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.326197    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35018678-433d-44e0-9188-4896dcd42d86-istio-token\" (UniqueName: \"kubernetes.io/projected/35018678-433d-44e0-9188-4896dcd42d86-istio-token\") pod \"35018678-433d-44e0-9188-4896dcd42d86\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") "
Oct 30 22:11:24.326445 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.326258    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-credential-socket\") pod \"35018678-433d-44e0-9188-4896dcd42d86\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") "
Oct 30 22:11:24.326445 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.326286    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35018678-433d-44e0-9188-4896dcd42d86-kube-api-access-cl2ct\" (UniqueName: \"kubernetes.io/projected/35018678-433d-44e0-9188-4896dcd42d86-kube-api-access-cl2ct\") pod \"35018678-433d-44e0-9188-4896dcd42d86\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") "
Oct 30 22:11:24.326445 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.326321    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-workload-socket\") pod \"35018678-433d-44e0-9188-4896dcd42d86\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") "
Oct 30 22:11:24.326445 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.326431    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-istio-envoy\") pod \"35018678-433d-44e0-9188-4896dcd42d86\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") "
Oct 30 22:11:24.326692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.326498    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-istio-data\") pod \"35018678-433d-44e0-9188-4896dcd42d86\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") "
Oct 30 22:11:24.326692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.326549    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/35018678-433d-44e0-9188-4896dcd42d86-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35018678-433d-44e0-9188-4896dcd42d86-istio-podinfo\") pod \"35018678-433d-44e0-9188-4896dcd42d86\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") "
Oct 30 22:11:24.326692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.326618    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-credential-socket" pod "35018678-433d-44e0-9188-4896dcd42d86" (UID: "35018678-433d-44e0-9188-4896dcd42d86"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:24.326692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.326650    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-workload-certs\") pod \"35018678-433d-44e0-9188-4896dcd42d86\" (UID: \"35018678-433d-44e0-9188-4896dcd42d86\") "
Oct 30 22:11:24.326692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.326656    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-workload-socket" pod "35018678-433d-44e0-9188-4896dcd42d86" (UID: "35018678-433d-44e0-9188-4896dcd42d86"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:24.326692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.326671    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35018678-433d-44e0-9188-4896dcd42d86-istiod-ca-cert" pod "35018678-433d-44e0-9188-4896dcd42d86" (UID: "35018678-433d-44e0-9188-4896dcd42d86"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:11:24.327006 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.326819    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-istio-data" pod "35018678-433d-44e0-9188-4896dcd42d86" (UID: "35018678-433d-44e0-9188-4896dcd42d86"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:24.327067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.327030    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35018678-433d-44e0-9188-4896dcd42d86-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:24.327067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.327046    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:24.327067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.327062    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:24.327229 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.327075    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:24.327362 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.327339    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-workload-certs" pod "35018678-433d-44e0-9188-4896dcd42d86" (UID: "35018678-433d-44e0-9188-4896dcd42d86"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:24.328739 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.328709    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35018678-433d-44e0-9188-4896dcd42d86-istio-token" pod "35018678-433d-44e0-9188-4896dcd42d86" (UID: "35018678-433d-44e0-9188-4896dcd42d86"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:24.328950 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.328916    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35018678-433d-44e0-9188-4896dcd42d86-kube-api-access-cl2ct" pod "35018678-433d-44e0-9188-4896dcd42d86" (UID: "35018678-433d-44e0-9188-4896dcd42d86"). InnerVolumeSpecName "kube-api-access-cl2ct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:24.329107 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.329087    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35018678-433d-44e0-9188-4896dcd42d86-istio-podinfo" pod "35018678-433d-44e0-9188-4896dcd42d86" (UID: "35018678-433d-44e0-9188-4896dcd42d86"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:11:24.329296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.329269    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-istio-envoy" pod "35018678-433d-44e0-9188-4896dcd42d86" (UID: "35018678-433d-44e0-9188-4896dcd42d86"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:11:24.341042 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.341013    5258 generic.go:356] "Generic (PLEG): container finished" podID="35018678-433d-44e0-9188-4896dcd42d86" containerID="4c9df31cd1eb2d48a5b79d6e674f094ef34efa3582c1ddedeaa626a8721e8e25" exitCode=0
Oct 30 22:11:24.341153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.341064    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"
Oct 30 22:11:24.341153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.341090    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg" event={"ID":"35018678-433d-44e0-9188-4896dcd42d86","Type":"ContainerDied","Data":"4c9df31cd1eb2d48a5b79d6e674f094ef34efa3582c1ddedeaa626a8721e8e25"}
Oct 30 22:11:24.341153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.341148    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg" event={"ID":"35018678-433d-44e0-9188-4896dcd42d86","Type":"ContainerDied","Data":"36c51fef602d7f37392409ceb69d537f2464652c7a91ef51d3f7d486478fb1fc"}
Oct 30 22:11:24.341269 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.341170    5258 scope.go:122] "RemoveContainer" containerID="4c9df31cd1eb2d48a5b79d6e674f094ef34efa3582c1ddedeaa626a8721e8e25"
Oct 30 22:11:24.370363 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.370333    5258 scope.go:122] "RemoveContainer" containerID="4c9df31cd1eb2d48a5b79d6e674f094ef34efa3582c1ddedeaa626a8721e8e25"
Oct 30 22:11:24.370889 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:11:24.370855    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c9df31cd1eb2d48a5b79d6e674f094ef34efa3582c1ddedeaa626a8721e8e25\": container with ID starting with 4c9df31cd1eb2d48a5b79d6e674f094ef34efa3582c1ddedeaa626a8721e8e25 not found: ID does not exist" containerID="4c9df31cd1eb2d48a5b79d6e674f094ef34efa3582c1ddedeaa626a8721e8e25"
Oct 30 22:11:24.371023 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.370895    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c9df31cd1eb2d48a5b79d6e674f094ef34efa3582c1ddedeaa626a8721e8e25"} err="failed to get container status \"4c9df31cd1eb2d48a5b79d6e674f094ef34efa3582c1ddedeaa626a8721e8e25\": rpc error: code = NotFound desc = could not find container \"4c9df31cd1eb2d48a5b79d6e674f094ef34efa3582c1ddedeaa626a8721e8e25\": container with ID starting with 4c9df31cd1eb2d48a5b79d6e674f094ef34efa3582c1ddedeaa626a8721e8e25 not found: ID does not exist"
Oct 30 22:11:24.427978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.427834    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35018678-433d-44e0-9188-4896dcd42d86-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:24.427978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.427868    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:24.427978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.427885    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35018678-433d-44e0-9188-4896dcd42d86-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:24.427978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.427901    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl2ct\" (UniqueName: \"kubernetes.io/projected/35018678-433d-44e0-9188-4896dcd42d86-kube-api-access-cl2ct\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:24.427978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.427916    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35018678-433d-44e0-9188-4896dcd42d86-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:24.542897 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.542811    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:24.543215 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.543192    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:24.543927 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.543910    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:11:24.577723 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.577663    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"]
Oct 30 22:11:24.580872 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.580847    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:24.581191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.581134    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:24.582077 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.582046    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-cdzxg"]
Oct 30 22:11:24.582180 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:24.582129    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:11:25.287568 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:25.287534    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:25.288107 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:25.287997    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:25.289068 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:25.289044    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:11:25.383555 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:25.383521    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="35018678-433d-44e0-9188-4896dcd42d86" path="/var/lib/kubelet/pods/35018678-433d-44e0-9188-4896dcd42d86/volumes"
Oct 30 22:11:27.505291 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:27.505211    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:27.515431 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:27.515401    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:11:32.586127 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:32.586089    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:36.596919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.596884    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-5t6vb-28s6w"]
Oct 30 22:11:36.597826 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.597406    5258 cpu_manager.go:414] "containerMap: removing container" podUID="35018678-433d-44e0-9188-4896dcd42d86" containerName="istio-proxy"
Oct 30 22:11:36.597826 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.597419    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="35018678-433d-44e0-9188-4896dcd42d86" containerName="istio-proxy"
Oct 30 22:11:36.597826 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.597532    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="35018678-433d-44e0-9188-4896dcd42d86" containerName="istio-proxy"
Oct 30 22:11:36.600886 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.600867    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:11:36.661633 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.661600    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-5t6vb-28s6w"]
Oct 30 22:11:36.723249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.723213    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d980fddc-7c98-4758-858a-2e335a3736d2-service-ca-bundle\") pod \"periodic-gathering-5t6vb-28s6w\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") " pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:11:36.723415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.723278    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d980fddc-7c98-4758-858a-2e335a3736d2-archives-path\") pod \"periodic-gathering-5t6vb-28s6w\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") " pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:11:36.723462 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.723416    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d980fddc-7c98-4758-858a-2e335a3736d2-trusted-ca-bundle\") pod \"periodic-gathering-5t6vb-28s6w\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") " pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:11:36.723462 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.723444    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9qrm\" (UniqueName: \"kubernetes.io/projected/d980fddc-7c98-4758-858a-2e335a3736d2-kube-api-access-t9qrm\") pod \"periodic-gathering-5t6vb-28s6w\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") " pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:11:36.824751 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.824717    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d980fddc-7c98-4758-858a-2e335a3736d2-service-ca-bundle\") pod \"periodic-gathering-5t6vb-28s6w\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") " pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:11:36.824918 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.824855    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d980fddc-7c98-4758-858a-2e335a3736d2-archives-path\") pod \"periodic-gathering-5t6vb-28s6w\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") " pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:11:36.824971 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.824936    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d980fddc-7c98-4758-858a-2e335a3736d2-trusted-ca-bundle\") pod \"periodic-gathering-5t6vb-28s6w\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") " pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:11:36.824971 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.824955    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9qrm\" (UniqueName: \"kubernetes.io/projected/d980fddc-7c98-4758-858a-2e335a3736d2-kube-api-access-t9qrm\") pod \"periodic-gathering-5t6vb-28s6w\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") " pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:11:36.825256 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.825232    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d980fddc-7c98-4758-858a-2e335a3736d2-archives-path\") pod \"periodic-gathering-5t6vb-28s6w\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") " pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:11:36.825476 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.825457    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d980fddc-7c98-4758-858a-2e335a3736d2-service-ca-bundle\") pod \"periodic-gathering-5t6vb-28s6w\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") " pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:11:36.825642 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.825622    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d980fddc-7c98-4758-858a-2e335a3736d2-trusted-ca-bundle\") pod \"periodic-gathering-5t6vb-28s6w\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") " pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:11:36.887214 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.887138    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9qrm\" (UniqueName: \"kubernetes.io/projected/d980fddc-7c98-4758-858a-2e335a3736d2-kube-api-access-t9qrm\") pod \"periodic-gathering-5t6vb-28s6w\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") " pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:11:36.914298 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:36.914262    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:11:37.306462 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:37.306437    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-5t6vb-28s6w"]
Oct 30 22:11:37.307447 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:11:37.307420    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd980fddc_7c98_4758_858a_2e335a3736d2.slice/crio-ac6d15c8fc624f19983a88ce2b68f81958a159e16ec4b08d3471dfebe5ac6832 WatchSource:0}: Error finding container ac6d15c8fc624f19983a88ce2b68f81958a159e16ec4b08d3471dfebe5ac6832: Status 404 returned error can't find the container with id ac6d15c8fc624f19983a88ce2b68f81958a159e16ec4b08d3471dfebe5ac6832
Oct 30 22:11:37.465346 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:37.465307    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-5t6vb-28s6w" event={"ID":"d980fddc-7c98-4758-858a-2e335a3736d2","Type":"ContainerStarted","Data":"ab1aed9dbca16faaeb7168cbc45d4a1c22f0be169ec6f8c4bdaba79effa666f2"}
Oct 30 22:11:37.465516 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:37.465384    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-5t6vb-28s6w" event={"ID":"d980fddc-7c98-4758-858a-2e335a3736d2","Type":"ContainerStarted","Data":"ac6d15c8fc624f19983a88ce2b68f81958a159e16ec4b08d3471dfebe5ac6832"}
Oct 30 22:11:37.582383 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:37.582329    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-5t6vb-28s6w" podStartSLOduration=1.582315651 podStartE2EDuration="1.582315651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:11:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:11:37.581273176 +0000 UTC m=+1012.312130318" watchObservedRunningTime="2026-10-30 22:11:37.582315651 +0000 UTC m=+1012.313172824"
Oct 30 22:11:37.803227 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:37.803194    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:42.781878 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:42.781850    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:43.162052 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:11:43.162015    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:11:47.792825 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:47.792792    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:52.816149 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:52.816109    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:57.880447 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:11:57.880412    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:03.024822 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:03.024790    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:08.084697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:08.084658    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:13.161939 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:12:13.161892    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:12:13.196841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:13.196799    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:17.940743 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:17.940707    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:18.295182 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:18.295087    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:18.312490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:18.312462    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:12:21.236744 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:21.236702    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:23.425205 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:23.425158    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:28.702356 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:28.702320    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:29.187570 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.187535    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"]
Oct 30 22:12:29.193103 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.193080    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"
Oct 30 22:12:29.216029 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.216005    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx2zn\" (UniqueName: \"kubernetes.io/projected/96f006f7-7303-448b-a840-e1cf95ee3b99-kube-api-access-sx2zn\") pod \"maas-api-revoke-sub-fbcd5b19-trhm7\" (UID: \"96f006f7-7303-448b-a840-e1cf95ee3b99\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"
Oct 30 22:12:29.216149 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.216113    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/96f006f7-7303-448b-a840-e1cf95ee3b99-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fbcd5b19-trhm7\" (UID: \"96f006f7-7303-448b-a840-e1cf95ee3b99\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"
Oct 30 22:12:29.216229 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.216217    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/96f006f7-7303-448b-a840-e1cf95ee3b99-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fbcd5b19-trhm7\" (UID: \"96f006f7-7303-448b-a840-e1cf95ee3b99\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"
Oct 30 22:12:29.252393 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.252363    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"]
Oct 30 22:12:29.296053 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.296026    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:12:29.296225 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.296137    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l4mjj\""
Oct 30 22:12:29.316956 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.316928    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx2zn\" (UniqueName: \"kubernetes.io/projected/96f006f7-7303-448b-a840-e1cf95ee3b99-kube-api-access-sx2zn\") pod \"maas-api-revoke-sub-fbcd5b19-trhm7\" (UID: \"96f006f7-7303-448b-a840-e1cf95ee3b99\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"
Oct 30 22:12:29.317133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.316999    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/96f006f7-7303-448b-a840-e1cf95ee3b99-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fbcd5b19-trhm7\" (UID: \"96f006f7-7303-448b-a840-e1cf95ee3b99\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"
Oct 30 22:12:29.317133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.317084    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/96f006f7-7303-448b-a840-e1cf95ee3b99-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fbcd5b19-trhm7\" (UID: \"96f006f7-7303-448b-a840-e1cf95ee3b99\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"
Oct 30 22:12:29.317735 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.317714    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/96f006f7-7303-448b-a840-e1cf95ee3b99-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fbcd5b19-trhm7\" (UID: \"96f006f7-7303-448b-a840-e1cf95ee3b99\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"
Oct 30 22:12:29.319260 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.319235    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/96f006f7-7303-448b-a840-e1cf95ee3b99-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fbcd5b19-trhm7\" (UID: \"96f006f7-7303-448b-a840-e1cf95ee3b99\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"
Oct 30 22:12:29.381604 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.381326    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx2zn\" (UniqueName: \"kubernetes.io/projected/96f006f7-7303-448b-a840-e1cf95ee3b99-kube-api-access-sx2zn\") pod \"maas-api-revoke-sub-fbcd5b19-trhm7\" (UID: \"96f006f7-7303-448b-a840-e1cf95ee3b99\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"
Oct 30 22:12:29.507631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.507530    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"
Oct 30 22:12:29.887051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.887021    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"]
Oct 30 22:12:29.889160 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:12:29.889126    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f006f7_7303_448b_a840_e1cf95ee3b99.slice/crio-360758731c45588d93d4cb7106826630b8ba5dba473041ae1d99de852803dc0a WatchSource:0}: Error finding container 360758731c45588d93d4cb7106826630b8ba5dba473041ae1d99de852803dc0a: Status 404 returned error can't find the container with id 360758731c45588d93d4cb7106826630b8ba5dba473041ae1d99de852803dc0a
Oct 30 22:12:29.891063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:29.891043    5258 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:12:30.904043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:30.904006    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7" event={"ID":"96f006f7-7303-448b-a840-e1cf95ee3b99","Type":"ContainerStarted","Data":"360758731c45588d93d4cb7106826630b8ba5dba473041ae1d99de852803dc0a"}
Oct 30 22:12:33.855574 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:33.855538    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:34.933827 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:34.933746    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7" event={"ID":"96f006f7-7303-448b-a840-e1cf95ee3b99","Type":"ContainerStarted","Data":"05b5823e4837ee5704efd9a5796c1e707aff4ff6466c582a68d0d01fa3956ea3"}
Oct 30 22:12:35.058264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:35.058199    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7" podStartSLOduration=1.6520368300000001 podStartE2EDuration="6.058179622s" totalImagesPullingTime="4.406142792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:12:35.050528981 +0000 UTC m=+1069.781386123" watchObservedRunningTime="2026-10-30 22:12:35.058179622 +0000 UTC m=+1069.789036772"
Oct 30 22:12:35.940780 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:35.940746    5258 generic.go:356] "Generic (PLEG): container finished" podID="96f006f7-7303-448b-a840-e1cf95ee3b99" containerID="05b5823e4837ee5704efd9a5796c1e707aff4ff6466c582a68d0d01fa3956ea3" exitCode=0
Oct 30 22:12:35.941220 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:35.940815    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7" event={"ID":"96f006f7-7303-448b-a840-e1cf95ee3b99","Type":"ContainerDied","Data":"05b5823e4837ee5704efd9a5796c1e707aff4ff6466c582a68d0d01fa3956ea3"}
Oct 30 22:12:37.110193 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:37.110162    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"
Oct 30 22:12:37.217348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:37.217263    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/96f006f7-7303-448b-a840-e1cf95ee3b99-kube-api-access-sx2zn\" (UniqueName: \"kubernetes.io/projected/96f006f7-7303-448b-a840-e1cf95ee3b99-kube-api-access-sx2zn\") pod \"96f006f7-7303-448b-a840-e1cf95ee3b99\" (UID: \"96f006f7-7303-448b-a840-e1cf95ee3b99\") "
Oct 30 22:12:37.217507 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:37.217425    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/96f006f7-7303-448b-a840-e1cf95ee3b99-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/96f006f7-7303-448b-a840-e1cf95ee3b99-maas-api-xks-ca\") pod \"96f006f7-7303-448b-a840-e1cf95ee3b99\" (UID: \"96f006f7-7303-448b-a840-e1cf95ee3b99\") "
Oct 30 22:12:37.217507 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:37.217457    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/96f006f7-7303-448b-a840-e1cf95ee3b99-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/96f006f7-7303-448b-a840-e1cf95ee3b99-maas-api-openshift-ca\") pod \"96f006f7-7303-448b-a840-e1cf95ee3b99\" (UID: \"96f006f7-7303-448b-a840-e1cf95ee3b99\") "
Oct 30 22:12:37.217801 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:37.217768    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f006f7-7303-448b-a840-e1cf95ee3b99-maas-api-openshift-ca" pod "96f006f7-7303-448b-a840-e1cf95ee3b99" (UID: "96f006f7-7303-448b-a840-e1cf95ee3b99"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:12:37.217964 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:37.217943    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/96f006f7-7303-448b-a840-e1cf95ee3b99-maas-api-openshift-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:37.219658 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:37.219633    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96f006f7-7303-448b-a840-e1cf95ee3b99-maas-api-xks-ca" pod "96f006f7-7303-448b-a840-e1cf95ee3b99" (UID: "96f006f7-7303-448b-a840-e1cf95ee3b99"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:12:37.219742 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:37.219659    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96f006f7-7303-448b-a840-e1cf95ee3b99-kube-api-access-sx2zn" pod "96f006f7-7303-448b-a840-e1cf95ee3b99" (UID: "96f006f7-7303-448b-a840-e1cf95ee3b99"). InnerVolumeSpecName "kube-api-access-sx2zn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:12:37.319295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:37.319259    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/96f006f7-7303-448b-a840-e1cf95ee3b99-maas-api-xks-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:37.319295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:37.319287    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx2zn\" (UniqueName: \"kubernetes.io/projected/96f006f7-7303-448b-a840-e1cf95ee3b99-kube-api-access-sx2zn\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:37.961076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:37.961039    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7" event={"ID":"96f006f7-7303-448b-a840-e1cf95ee3b99","Type":"ContainerDied","Data":"360758731c45588d93d4cb7106826630b8ba5dba473041ae1d99de852803dc0a"}
Oct 30 22:12:37.961281 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:37.961100    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="360758731c45588d93d4cb7106826630b8ba5dba473041ae1d99de852803dc0a"
Oct 30 22:12:37.961281 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:37.961169    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"
Oct 30 22:12:38.980655 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:38.979263    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:43.161282 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:12:43.161241    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:12:44.117897 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:44.117863    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:49.187849 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:49.187809    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:54.391914 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:54.391880    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:57.027974 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:57.027897    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:12:59.501477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:12:59.501441    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:01.433448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.433412    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"]
Oct 30 22:13:01.434043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.434028    5258 cpu_manager.go:414] "containerMap: removing container" podUID="96f006f7-7303-448b-a840-e1cf95ee3b99" containerName="revoke-keys"
Oct 30 22:13:01.434100 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.434045    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="96f006f7-7303-448b-a840-e1cf95ee3b99" containerName="revoke-keys"
Oct 30 22:13:01.434154 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.434144    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="96f006f7-7303-448b-a840-e1cf95ee3b99" containerName="revoke-keys"
Oct 30 22:13:01.437751 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.437735    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.498665 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.498631    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-data\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.498863 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.498672    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-workload-certs\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.498863 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.498824    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istiod-ca-cert\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.498983 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.498872    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2sbp\" (UniqueName: \"kubernetes.io/projected/6b2ea3e6-d869-4d74-999b-be8d970d1c17-kube-api-access-k2sbp\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.498983 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.498948    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-envoy\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.499135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.499104    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-workload-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.499181 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.499149    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-token\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.499312 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.499290    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-podinfo\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.499374 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.499356    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-credential-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.515465 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.513145    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-2a4123-openshift-default-dockercfg-ldqs2\""
Oct 30 22:13:01.553920 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.553886    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"]
Oct 30 22:13:01.600019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.599984    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-workload-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.600019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.600020    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-token\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.600268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.600069    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-podinfo\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.600268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.600116    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-credential-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.600268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.600151    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-data\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.600268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.600175    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-workload-certs\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.600268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.600261    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istiod-ca-cert\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.600548 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.600314    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2sbp\" (UniqueName: \"kubernetes.io/projected/6b2ea3e6-d869-4d74-999b-be8d970d1c17-kube-api-access-k2sbp\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.600548 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.600356    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-envoy\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.600548 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.600455    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-workload-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.600548 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.600490    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-credential-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.600970 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.600946    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-workload-certs\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.601366 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.601179    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istiod-ca-cert\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.601524 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.601278    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-data\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.602756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.602732    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-envoy\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.603236 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.603214    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-podinfo\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.696610 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.696516    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-token\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.698635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.698604    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2sbp\" (UniqueName: \"kubernetes.io/projected/6b2ea3e6-d869-4d74-999b-be8d970d1c17-kube-api-access-k2sbp\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:01.750841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:01.750803    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:02.192794 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:02.192766    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"]
Oct 30 22:13:02.194397 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:13:02.194366    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2ea3e6_d869_4d74_999b_be8d970d1c17.slice/crio-f9ef0cc4dc944e7fd9cf78f7718fc46d4558941eb08fc7de24947ce526f9fa37 WatchSource:0}: Error finding container f9ef0cc4dc944e7fd9cf78f7718fc46d4558941eb08fc7de24947ce526f9fa37: Status 404 returned error can't find the container with id f9ef0cc4dc944e7fd9cf78f7718fc46d4558941eb08fc7de24947ce526f9fa37
Oct 30 22:13:02.197298 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:02.197261    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:13:02.197391 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:02.197331    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:13:02.197391 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:02.197366    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:13:02.260501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:02.260466    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls" event={"ID":"6b2ea3e6-d869-4d74-999b-be8d970d1c17","Type":"ContainerStarted","Data":"f9ef0cc4dc944e7fd9cf78f7718fc46d4558941eb08fc7de24947ce526f9fa37"}
Oct 30 22:13:03.176612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.175748    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"]
Oct 30 22:13:03.185430 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.185403    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.232254 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.232223    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"]
Oct 30 22:13:03.277612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.276914    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-963c3a-openshift-default-dockercfg-fd9jr\""
Oct 30 22:13:03.293349 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.293309    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls" event={"ID":"6b2ea3e6-d869-4d74-999b-be8d970d1c17","Type":"ContainerStarted","Data":"7ce256fe000f6846df955879bb065d8635721ad8266727435e60fb63f71831a0"}
Oct 30 22:13:03.320222 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.320188    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-workload-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.320376 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.320253    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-podinfo\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.320376 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.320334    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-token\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.320452 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.320382    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-data\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.320490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.320463    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-envoy\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.320527 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.320518    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-workload-certs\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.320559 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.320539    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrdwb\" (UniqueName: \"kubernetes.io/projected/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-kube-api-access-jrdwb\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.320680 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.320660    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-credential-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.320721 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.320691    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istiod-ca-cert\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.422078 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.422048    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-data\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.422302 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.422113    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-envoy\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.422302 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.422172    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-workload-certs\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.422302 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.422200    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrdwb\" (UniqueName: \"kubernetes.io/projected/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-kube-api-access-jrdwb\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.422302 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.422236    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-credential-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.422302 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.422262    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istiod-ca-cert\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.422643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.422342    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-workload-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.422643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.422429    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-podinfo\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.422643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.422495    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-token\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.422643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.422542    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-data\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.422643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.422631    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-workload-certs\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.423084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.423059    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-credential-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.423157 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.423097    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istiod-ca-cert\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.423157 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.423112    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-workload-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.424632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.424603    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-envoy\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.424880 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.424863    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-podinfo\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.480084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.479955    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls" podStartSLOduration=2.479937434 podStartE2EDuration="2.479937434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:13:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:03.476323452 +0000 UTC m=+1098.207180596" watchObservedRunningTime="2026-10-30 22:13:03.479937434 +0000 UTC m=+1098.210794577"
Oct 30 22:13:03.487242 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.487205    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-token\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.487385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.487331    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrdwb\" (UniqueName: \"kubernetes.io/projected/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-kube-api-access-jrdwb\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.500132 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.500105    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:03.775841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.775742    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:03.777403 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.777377    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:13:03.777523 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.777434    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls" podUID="6b2ea3e6-d869-4d74-999b-be8d970d1c17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 22:13:03.980117 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.980088    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"]
Oct 30 22:13:03.981160 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:13:03.981136    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d87229_3602_4837_bc3c_a51ddf3c4cf5.slice/crio-2d595ce5ded4ebff78ae25813ca74afb545805dca37d8f8efa59ba833553eb89 WatchSource:0}: Error finding container 2d595ce5ded4ebff78ae25813ca74afb545805dca37d8f8efa59ba833553eb89: Status 404 returned error can't find the container with id 2d595ce5ded4ebff78ae25813ca74afb545805dca37d8f8efa59ba833553eb89
Oct 30 22:13:03.984200 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.984162    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:13:03.984273 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.984246    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:13:03.984323 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:03.984288    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:13:04.301221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:04.301123    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht" event={"ID":"f3d87229-3602-4837-bc3c-a51ddf3c4cf5","Type":"ContainerStarted","Data":"a3051ac899587421e6c01c47848805996552a30b17561b75160d0d15a62a5cfa"}
Oct 30 22:13:04.301221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:04.301186    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht" event={"ID":"f3d87229-3602-4837-bc3c-a51ddf3c4cf5","Type":"ContainerStarted","Data":"2d595ce5ded4ebff78ae25813ca74afb545805dca37d8f8efa59ba833553eb89"}
Oct 30 22:13:04.430511 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:04.430457    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht" podStartSLOduration=1.430442115 podStartE2EDuration="1.430442115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:04.428185718 +0000 UTC m=+1099.159042862" watchObservedRunningTime="2026-10-30 22:13:04.430442115 +0000 UTC m=+1099.161299323"
Oct 30 22:13:04.500875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:04.500824    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:04.609337 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:04.609292    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:04.772615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:04.767702    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:13:04.772615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:04.767767    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls" podUID="6b2ea3e6-d869-4d74-999b-be8d970d1c17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 22:13:05.506437 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:05.506180    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 22:13:05.506437 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:05.506230    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht" podUID="f3d87229-3602-4837-bc3c-a51ddf3c4cf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 22:13:05.769270 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:05.769160    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:13:05.769568 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:05.769521    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls" podUID="6b2ea3e6-d869-4d74-999b-be8d970d1c17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 22:13:06.501614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:06.500973    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 22:13:06.501614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:06.501038    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht" podUID="f3d87229-3602-4837-bc3c-a51ddf3c4cf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 22:13:06.764708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:06.754920    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:13:06.764708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:06.754978    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls" podUID="6b2ea3e6-d869-4d74-999b-be8d970d1c17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 22:13:07.502624 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:07.501963    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 22:13:07.502624 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:07.502025    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht" podUID="f3d87229-3602-4837-bc3c-a51ddf3c4cf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 22:13:07.755055 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:07.754960    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:13:07.755306 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:07.755276    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls" podUID="6b2ea3e6-d869-4d74-999b-be8d970d1c17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 22:13:08.501380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:08.501345    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 22:13:08.501822 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:08.501400    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht" podUID="f3d87229-3602-4837-bc3c-a51ddf3c4cf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 22:13:08.755679 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:08.754947    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:13:08.755679 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:08.755010    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls" podUID="6b2ea3e6-d869-4d74-999b-be8d970d1c17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 22:13:09.501220 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:09.501184    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 22:13:09.501400 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:09.501240    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht" podUID="f3d87229-3602-4837-bc3c-a51ddf3c4cf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 22:13:09.778680 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:09.777934    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:09.782611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:09.779416    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:09.783961 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:09.783933    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:13:09.814816 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:09.814781    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:10.501312 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:10.501282    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 22:13:10.501634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:10.501335    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht" podUID="f3d87229-3602-4837-bc3c-a51ddf3c4cf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 22:13:11.506458 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:11.506429    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:11.506943 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:11.506911    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:11.507656 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:11.507632    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:13:13.164583 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:13:13.164547    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:13:13.365693 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:13.365660    5258 generic.go:356] "Generic (PLEG): container finished" podID="d980fddc-7c98-4758-858a-2e335a3736d2" containerID="ab1aed9dbca16faaeb7168cbc45d4a1c22f0be169ec6f8c4bdaba79effa666f2" exitCode=0
Oct 30 22:13:13.365858 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:13.365734    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-5t6vb-28s6w" event={"ID":"d980fddc-7c98-4758-858a-2e335a3736d2","Type":"ContainerDied","Data":"ab1aed9dbca16faaeb7168cbc45d4a1c22f0be169ec6f8c4bdaba79effa666f2"}
Oct 30 22:13:13.522843 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:13.522807    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:14.557315 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:14.557291    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:13:14.700642 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:14.700517    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d980fddc-7c98-4758-858a-2e335a3736d2-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d980fddc-7c98-4758-858a-2e335a3736d2-service-ca-bundle\") pod \"d980fddc-7c98-4758-858a-2e335a3736d2\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") "
Oct 30 22:13:14.700818 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:14.700680    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d980fddc-7c98-4758-858a-2e335a3736d2-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d980fddc-7c98-4758-858a-2e335a3736d2-trusted-ca-bundle\") pod \"d980fddc-7c98-4758-858a-2e335a3736d2\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") "
Oct 30 22:13:14.700818 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:14.700712    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d980fddc-7c98-4758-858a-2e335a3736d2-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d980fddc-7c98-4758-858a-2e335a3736d2-archives-path\") pod \"d980fddc-7c98-4758-858a-2e335a3736d2\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") "
Oct 30 22:13:14.700818 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:14.700766    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d980fddc-7c98-4758-858a-2e335a3736d2-kube-api-access-t9qrm\" (UniqueName: \"kubernetes.io/projected/d980fddc-7c98-4758-858a-2e335a3736d2-kube-api-access-t9qrm\") pod \"d980fddc-7c98-4758-858a-2e335a3736d2\" (UID: \"d980fddc-7c98-4758-858a-2e335a3736d2\") "
Oct 30 22:13:14.701011 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:14.700917    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d980fddc-7c98-4758-858a-2e335a3736d2-service-ca-bundle" pod "d980fddc-7c98-4758-858a-2e335a3736d2" (UID: "d980fddc-7c98-4758-858a-2e335a3736d2"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:14.701071 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:14.701058    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d980fddc-7c98-4758-858a-2e335a3736d2-trusted-ca-bundle" pod "d980fddc-7c98-4758-858a-2e335a3736d2" (UID: "d980fddc-7c98-4758-858a-2e335a3736d2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:14.701130 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:14.701084    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d980fddc-7c98-4758-858a-2e335a3736d2-archives-path" pod "d980fddc-7c98-4758-858a-2e335a3736d2" (UID: "d980fddc-7c98-4758-858a-2e335a3736d2"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:14.701368 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:14.701344    5258 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d980fddc-7c98-4758-858a-2e335a3736d2-trusted-ca-bundle\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:14.701455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:14.701372    5258 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/d980fddc-7c98-4758-858a-2e335a3736d2-archives-path\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:14.701455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:14.701387    5258 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d980fddc-7c98-4758-858a-2e335a3736d2-service-ca-bundle\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:14.702990 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:14.702968    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d980fddc-7c98-4758-858a-2e335a3736d2-kube-api-access-t9qrm" pod "d980fddc-7c98-4758-858a-2e335a3736d2" (UID: "d980fddc-7c98-4758-858a-2e335a3736d2"). InnerVolumeSpecName "kube-api-access-t9qrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:14.802290 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:14.802256    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9qrm\" (UniqueName: \"kubernetes.io/projected/d980fddc-7c98-4758-858a-2e335a3736d2-kube-api-access-t9qrm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:14.899624 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:14.899556    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:15.385858 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:15.385829    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-5t6vb-28s6w"
Oct 30 22:13:15.386059 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:15.385860    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-5t6vb-28s6w" event={"ID":"d980fddc-7c98-4758-858a-2e335a3736d2","Type":"ContainerDied","Data":"ac6d15c8fc624f19983a88ce2b68f81958a159e16ec4b08d3471dfebe5ac6832"}
Oct 30 22:13:15.386059 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:15.385899    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac6d15c8fc624f19983a88ce2b68f81958a159e16ec4b08d3471dfebe5ac6832"
Oct 30 22:13:16.406477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:16.406439    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:16.711472 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:16.711379    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:20.152084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:20.152045    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:21.273121 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:21.273083    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:21.576571 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:21.576536    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:26.291551 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:26.291505    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:29.514568 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:29.514530    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:13:31.799154 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:31.799111    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:32.861648 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:32.861609    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:37.352038 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:37.352000    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:38.817167 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:38.817134    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:42.414527 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:42.414491    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:43.179769 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:13:43.179723    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:13:44.277152 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.277117    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"]
Oct 30 22:13:44.277739 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.277722    5258 cpu_manager.go:414] "containerMap: removing container" podUID="d980fddc-7c98-4758-858a-2e335a3736d2" containerName="insights-gathering"
Oct 30 22:13:44.277739 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.277739    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d980fddc-7c98-4758-858a-2e335a3736d2" containerName="insights-gathering"
Oct 30 22:13:44.277854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.277824    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="d980fddc-7c98-4758-858a-2e335a3736d2" containerName="insights-gathering"
Oct 30 22:13:44.281563 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.281545    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.354748 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.354716    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz5t8\" (UniqueName: \"kubernetes.io/projected/8b2b24d4-20da-4f1d-b968-c11031f364c4-kube-api-access-kz5t8\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.354893 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.354758    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2b24d4-20da-4f1d-b968-c11031f364c4-tls-certs\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.354893 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.354789    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-dshm\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.354969 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.354904    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-home\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.355005 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.354969    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-tmp-dir\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.355128 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.355107    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-model-cache\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.384888 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.384862    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"]
Oct 30 22:13:44.386144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.386127    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-97aa64\"/\"kube-root-ca.crt\""
Oct 30 22:13:44.386407 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.386390    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-97aa64\"/\"distinct-w4-97aa64-kserve-self-signed-certs\""
Oct 30 22:13:44.386486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.386425    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-97aa64\"/\"openshift-service-ca.crt\""
Oct 30 22:13:44.386486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.386483    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-97aa64\"/\"default-dockercfg-v57fc\""
Oct 30 22:13:44.438864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.438826    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:44.456403 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.456361    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-model-cache\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.456608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.456441    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz5t8\" (UniqueName: \"kubernetes.io/projected/8b2b24d4-20da-4f1d-b968-c11031f364c4-kube-api-access-kz5t8\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.456608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.456479    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2b24d4-20da-4f1d-b968-c11031f364c4-tls-certs\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.456732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.456634    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-dshm\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.456732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.456701    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-home\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.456847 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.456778    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-model-cache\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.456847 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.456817    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-tmp-dir\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.457095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.457070    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-home\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.457212 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.457177    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-tmp-dir\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.458847 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.458817    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-dshm\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.459084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.459070    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2b24d4-20da-4f1d-b968-c11031f364c4-tls-certs\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.519923 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.519894    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz5t8\" (UniqueName: \"kubernetes.io/projected/8b2b24d4-20da-4f1d-b968-c11031f364c4-kube-api-access-kz5t8\") pod \"distinct-w4-97aa64-kserve-77fc7dc957-z5mks\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:44.594402 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:44.594367    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:45.022075 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:45.022047    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"]
Oct 30 22:13:45.023080 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:13:45.023054    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b2b24d4_20da_4f1d_b968_c11031f364c4.slice/crio-01aa91dbae2acaff90b521e766a7715b3d0e3a126bdf5220bba7f051d7de8751 WatchSource:0}: Error finding container 01aa91dbae2acaff90b521e766a7715b3d0e3a126bdf5220bba7f051d7de8751: Status 404 returned error can't find the container with id 01aa91dbae2acaff90b521e766a7715b3d0e3a126bdf5220bba7f051d7de8751
Oct 30 22:13:45.633754 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:45.633719    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" event={"ID":"8b2b24d4-20da-4f1d-b968-c11031f364c4","Type":"ContainerStarted","Data":"5c8cd0c796456dd0429bae2197c43de5ca77cdc600f1108e1473145757921cfd"}
Oct 30 22:13:45.634166 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:45.633763    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" event={"ID":"8b2b24d4-20da-4f1d-b968-c11031f364c4","Type":"ContainerStarted","Data":"01aa91dbae2acaff90b521e766a7715b3d0e3a126bdf5220bba7f051d7de8751"}
Oct 30 22:13:45.758385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:45.758334    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podStartSLOduration=1.758319541 podStartE2EDuration="1.758319541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:45.754913276 +0000 UTC m=+1140.485770419" watchObservedRunningTime="2026-10-30 22:13:45.758319541 +0000 UTC m=+1140.489176684"
Oct 30 22:13:46.595053 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:46.595020    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:47.492048 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:47.492017    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:47.827761 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:47.827727    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:52.475048 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:52.475010    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:54.595083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:54.595044    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:54.610213 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:54.610188    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:54.713920 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:54.713896    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:13:56.025456 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:56.025418    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:13:57.990762 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:13:57.990724    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:01.891478 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:01.891436    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:03.358871 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:03.358834    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:08.278998 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:08.278937    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:13.162108 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:14:13.162065    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:14:13.315979 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:13.315930    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:17.537489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.537449    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"]
Oct 30 22:14:17.541786 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.541762    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.647126 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.647093    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"]
Oct 30 22:14:17.674724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.674688    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-credential-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.674908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.674732    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-workload-certs\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.674908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.674818    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-workload-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.675043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.674915    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istiod-ca-cert\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.675043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.674956    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-podinfo\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.675154 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.675058    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2smjd\" (UniqueName: \"kubernetes.io/projected/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-kube-api-access-2smjd\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.675223 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.675159    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-envoy\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.675223 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.675186    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-data\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.675322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.675258    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-token\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.777045 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.777012    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-workload-certs\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.777045 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.777054    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-workload-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.777309 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.777088    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istiod-ca-cert\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.777309 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.777137    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-podinfo\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.777309 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.777199    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2smjd\" (UniqueName: \"kubernetes.io/projected/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-kube-api-access-2smjd\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.777309 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.777291    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-envoy\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.777524 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.777315    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-data\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.777524 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.777393    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-token\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.777524 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.777501    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-credential-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.777524 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.777518    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-workload-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.777820 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.777794    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-data\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.778008 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.777896    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-credential-socket\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.778143 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.778051    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-workload-certs\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.778227 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.778124    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istiod-ca-cert\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.780515 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.780480    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-podinfo\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.780639 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.780516    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-envoy\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.842931 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.842903    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-token\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.844157 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.844135    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2smjd\" (UniqueName: \"kubernetes.io/projected/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-kube-api-access-2smjd\") pod \"e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") " pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:17.856930 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:17.856910    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:18.124047 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.123980    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"]
Oct 30 22:14:18.129385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.129365    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.192634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.192577    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"]
Oct 30 22:14:18.283631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.283584    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istiod-ca-cert\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.283789 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.283740    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-podinfo\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.283878 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.283848    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-workload-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.283941 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.283909    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-workload-certs\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.283985 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.283952    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcrzb\" (UniqueName: \"kubernetes.io/projected/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-kube-api-access-hcrzb\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.284057 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.284046    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-token\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.284099 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.284085    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-credential-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.284155 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.284129    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-envoy\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.284262 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.284236    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-data\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.299291 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.299264    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"]
Oct 30 22:14:18.300073 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:14:18.300039    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b86c2d_18a0_49bd_84cf_01bba6c4b755.slice/crio-5f86090d04d00e506e8a11b98a1d692755cb8aa799176a1cc068b9d5cf9e647e WatchSource:0}: Error finding container 5f86090d04d00e506e8a11b98a1d692755cb8aa799176a1cc068b9d5cf9e647e: Status 404 returned error can't find the container with id 5f86090d04d00e506e8a11b98a1d692755cb8aa799176a1cc068b9d5cf9e647e
Oct 30 22:14:18.302301 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.302273    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:14:18.302396 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.302346    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:14:18.302396 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.302393    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:14:18.385859 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.385829    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-workload-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.385992 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.385874    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-workload-certs\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.385992 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.385900    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcrzb\" (UniqueName: \"kubernetes.io/projected/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-kube-api-access-hcrzb\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.386265 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.385968    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-token\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.386322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.386273    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-workload-certs\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.386322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.386315    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-credential-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.386431 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.386372    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-envoy\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.386431 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.386419    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-data\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.386535 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.386492    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istiod-ca-cert\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.386634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.386616    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-podinfo\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.386697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.386641    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-credential-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.387238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.387209    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-workload-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.387370 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.387344    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-data\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.387674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.387652    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istiod-ca-cert\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.389324 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.389299    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-envoy\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.389485 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.389468    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-podinfo\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.458609 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.458146    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:18.462850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.460437    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-token\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.462850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.461258    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcrzb\" (UniqueName: \"kubernetes.io/projected/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-kube-api-access-hcrzb\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.571067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.571033    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"]
Oct 30 22:14:18.576789 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.576746    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.634279 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.630505    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-77cb1f\"/\"distinct-2-w1-77cb1f-kserve-self-signed-certs\""
Oct 30 22:14:18.639333 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.639301    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"]
Oct 30 22:14:18.713623 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.710439    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-dshm\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.713623 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.710506    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-model-cache\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.713623 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.710578    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp25w\" (UniqueName: \"kubernetes.io/projected/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-kube-api-access-vp25w\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.713623 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.710706    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-tls-certs\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.713623 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.710776    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-tmp-dir\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.713623 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.710846    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-home\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.729251 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.729140    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:18.745159 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.745126    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:18.811977 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.811943    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-dshm\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.812158 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.812023    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-model-cache\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.812158 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.812097    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp25w\" (UniqueName: \"kubernetes.io/projected/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-kube-api-access-vp25w\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.812285 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.812159    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-tls-certs\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.812285 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.812231    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-tmp-dir\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.812403 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.812296    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-home\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.812846 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.812818    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-home\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.812955 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.812874    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-model-cache\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.813019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.812999    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-tmp-dir\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.815693 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.815447    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-dshm\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.826673 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.816943    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-tls-certs\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.877892 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.877850    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp25w\" (UniqueName: \"kubernetes.io/projected/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-kube-api-access-vp25w\") pod \"distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") " pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:18.895796 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.895679    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx" event={"ID":"b7b86c2d-18a0-49bd-84cf-01bba6c4b755","Type":"ContainerStarted","Data":"bf22925509b3afe35b674fcb7f3d910b5e48cc22663bce2cfdc1e08fa0ee46cb"}
Oct 30 22:14:18.895796 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.895731    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx" event={"ID":"b7b86c2d-18a0-49bd-84cf-01bba6c4b755","Type":"ContainerStarted","Data":"5f86090d04d00e506e8a11b98a1d692755cb8aa799176a1cc068b9d5cf9e647e"}
Oct 30 22:14:18.920512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:18.920487    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:19.218466 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:19.218416    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx" podStartSLOduration=2.218399439 podStartE2EDuration="2.218399439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:19.030406034 +0000 UTC m=+1173.761263177" watchObservedRunningTime="2026-10-30 22:14:19.218399439 +0000 UTC m=+1173.949256583"
Oct 30 22:14:19.218639 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:19.218620    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"]
Oct 30 22:14:19.219469 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:14:19.219451    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a572fa_5ae1_4e61_aa67_d2bf19dd4776.slice/crio-9b18517985d7644478f259455734bdbc2b30700d85f8ce5f9dd04960fd7b6375 WatchSource:0}: Error finding container 9b18517985d7644478f259455734bdbc2b30700d85f8ce5f9dd04960fd7b6375: Status 404 returned error can't find the container with id 9b18517985d7644478f259455734bdbc2b30700d85f8ce5f9dd04960fd7b6375
Oct 30 22:14:19.222284 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:19.222251    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:14:19.222372 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:19.222319    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:14:19.222372 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:19.222349    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:14:19.316245 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:19.316219    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"]
Oct 30 22:14:19.317783 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:14:19.317751    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod338d3119_5b9d_44eb_bbc3_19f46bd9fe60.slice/crio-34d8dc743e79dc6f871f271de6da5cf932d6f80dcad67ccca576cac970c02149 WatchSource:0}: Error finding container 34d8dc743e79dc6f871f271de6da5cf932d6f80dcad67ccca576cac970c02149: Status 404 returned error can't find the container with id 34d8dc743e79dc6f871f271de6da5cf932d6f80dcad67ccca576cac970c02149
Oct 30 22:14:19.860938 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:19.857921    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:19.868379 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:19.868049    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 22:14:19.868379 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:19.868111    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx" podUID="b7b86c2d-18a0-49bd-84cf-01bba6c4b755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 22:14:19.905458 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:19.905420    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" event={"ID":"338d3119-5b9d-44eb-bbc3-19f46bd9fe60","Type":"ContainerStarted","Data":"040a5d30a08b6f39b2e4e651e6391010e29adb387ef31fee84dd2fb53244bc74"}
Oct 30 22:14:19.905673 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:19.905470    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" event={"ID":"338d3119-5b9d-44eb-bbc3-19f46bd9fe60","Type":"ContainerStarted","Data":"34d8dc743e79dc6f871f271de6da5cf932d6f80dcad67ccca576cac970c02149"}
Oct 30 22:14:19.907479 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:19.907452    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v" event={"ID":"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776","Type":"ContainerStarted","Data":"763a7c7a5b2e2ed5a0cb31235cf4ab6c9c97c6de9b3b1ef351afa36f66eee23c"}
Oct 30 22:14:19.907642 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:19.907499    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v" event={"ID":"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776","Type":"ContainerStarted","Data":"9b18517985d7644478f259455734bdbc2b30700d85f8ce5f9dd04960fd7b6375"}
Oct 30 22:14:19.920903 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:19.920882    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:20.036778 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:20.036714    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podStartSLOduration=2.036699667 podStartE2EDuration="2.036699667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:20.035871635 +0000 UTC m=+1174.766728778" watchObservedRunningTime="2026-10-30 22:14:20.036699667 +0000 UTC m=+1174.767556809"
Oct 30 22:14:20.168508 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:20.168383    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v" podStartSLOduration=2.168362472 podStartE2EDuration="2.168362472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:20.167107127 +0000 UTC m=+1174.897964268" watchObservedRunningTime="2026-10-30 22:14:20.168362472 +0000 UTC m=+1174.899219623"
Oct 30 22:14:20.746821 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:20.746232    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:20.747858 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:20.747834    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 22:14:20.747940 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:20.747880    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v" podUID="f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 22:14:20.859614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:20.858046    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 22:14:20.859614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:20.858129    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx" podUID="b7b86c2d-18a0-49bd-84cf-01bba6c4b755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 22:14:21.746350 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:21.746319    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 22:14:21.746745 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:21.746379    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v" podUID="f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 22:14:21.859084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:21.859050    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 22:14:21.859494 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:21.859459    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx" podUID="b7b86c2d-18a0-49bd-84cf-01bba6c4b755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 22:14:21.939929 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:21.939896    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:22.746140 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:22.746086    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 22:14:22.746352 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:22.746153    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v" podUID="f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 22:14:22.862614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:22.858973    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 22:14:22.862614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:22.859040    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx" podUID="b7b86c2d-18a0-49bd-84cf-01bba6c4b755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 22:14:23.746540 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:23.746496    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 22:14:23.746778 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:23.746551    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v" podUID="f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 22:14:23.871614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:23.861971    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 22:14:23.871614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:23.862035    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx" podUID="b7b86c2d-18a0-49bd-84cf-01bba6c4b755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 22:14:24.480784 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:24.480751    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:24.746430 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:24.746350    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 22:14:24.746430 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:24.746412    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v" podUID="f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 22:14:24.857992 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:24.857954    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 22:14:24.858270 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:24.858240    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx" podUID="b7b86c2d-18a0-49bd-84cf-01bba6c4b755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 22:14:25.745645 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:25.745554    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 22:14:25.746030 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:25.745659    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v" podUID="f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 22:14:25.863565 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:25.863532    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:25.864085 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:25.864065    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:25.864930 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:25.864908    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:14:26.835703 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:26.835674    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:26.836198 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:26.836172    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:26.837328 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:26.837308    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:14:28.921454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:28.921413    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:28.934538 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:28.934513    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:29.004861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:29.004833    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:14:29.592272 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:29.592237    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:34.708742 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:34.708705    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:38.183172 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:38.183133    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:14:39.798861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:39.794793    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:43.162360 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:14:43.162312    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:14:44.797730 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:44.797671    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:45.528782 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:45.528754    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:14:45.531983 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:45.531954    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:14:49.024957 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.024920    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"]
Oct 30 22:14:49.029433 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.029415    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.087347 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.087316    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-istio-envoy\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.087480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.087357    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c2n9\" (UniqueName: \"kubernetes.io/projected/57380917-8312-4d27-b610-ced9e601a8ef-kube-api-access-7c2n9\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.087480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.087377    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-workload-certs\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.087578 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.087551    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-credential-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.087705 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.087687    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57380917-8312-4d27-b610-ced9e601a8ef-istiod-ca-cert\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.087760 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.087723    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57380917-8312-4d27-b610-ced9e601a8ef-istio-podinfo\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.087834 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.087810    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-istio-data\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.087894 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.087866    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57380917-8312-4d27-b610-ced9e601a8ef-istio-token\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.087985 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.087971    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-workload-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.137776 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.137743    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"]
Oct 30 22:14:49.189530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.189498    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-istio-envoy\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.189530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.189534    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c2n9\" (UniqueName: \"kubernetes.io/projected/57380917-8312-4d27-b610-ced9e601a8ef-kube-api-access-7c2n9\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.190135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.189561    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-workload-certs\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.190135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.189656    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-credential-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.190135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.189743    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57380917-8312-4d27-b610-ced9e601a8ef-istiod-ca-cert\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.190135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.189773    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57380917-8312-4d27-b610-ced9e601a8ef-istio-podinfo\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.190135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.189810    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-istio-data\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.190135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.189849    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57380917-8312-4d27-b610-ced9e601a8ef-istio-token\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.190135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.189923    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-workload-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.190135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.190117    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-credential-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.190550 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.190413    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-istio-data\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.190631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.190582    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-workload-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.190689 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.190633    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-workload-certs\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.190842 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.190821    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57380917-8312-4d27-b610-ced9e601a8ef-istiod-ca-cert\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.192440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.192409    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-istio-envoy\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.192547 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.192529    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57380917-8312-4d27-b610-ced9e601a8ef-istio-podinfo\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.251288 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.251262    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c2n9\" (UniqueName: \"kubernetes.io/projected/57380917-8312-4d27-b610-ced9e601a8ef-kube-api-access-7c2n9\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.251529 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.251505    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57380917-8312-4d27-b610-ced9e601a8ef-istio-token\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.343122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.343088    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:49.817153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.817121    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"]
Oct 30 22:14:49.817551 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:14:49.817523    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57380917_8312_4d27_b610_ced9e601a8ef.slice/crio-c1f27321fd2b1aa2a04657d7a09b1b45db64a4d08b2c356151a57a665a299941 WatchSource:0}: Error finding container c1f27321fd2b1aa2a04657d7a09b1b45db64a4d08b2c356151a57a665a299941: Status 404 returned error can't find the container with id c1f27321fd2b1aa2a04657d7a09b1b45db64a4d08b2c356151a57a665a299941
Oct 30 22:14:49.820057 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.820027    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:14:49.820131 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.820090    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:14:49.820131 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:49.820118    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:14:50.152641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:50.152517    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b" event={"ID":"57380917-8312-4d27-b610-ced9e601a8ef","Type":"ContainerStarted","Data":"e2d1555df790123154661db683c27d0e2f64410c9d35168d656424a6185e8dd5"}
Oct 30 22:14:50.152641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:50.152605    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b" event={"ID":"57380917-8312-4d27-b610-ced9e601a8ef","Type":"ContainerStarted","Data":"c1f27321fd2b1aa2a04657d7a09b1b45db64a4d08b2c356151a57a665a299941"}
Oct 30 22:14:50.263668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:50.263622    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:50.282989 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:50.282940    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b" podStartSLOduration=2.282926248 podStartE2EDuration="2.282926248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:50.28141407 +0000 UTC m=+1205.012271215" watchObservedRunningTime="2026-10-30 22:14:50.282926248 +0000 UTC m=+1205.013783443"
Oct 30 22:14:50.343243 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:50.343214    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:50.344530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:50.344504    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 22:14:50.344668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:50.344553    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b" podUID="57380917-8312-4d27-b610-ced9e601a8ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 22:14:51.343831 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:51.343793    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 22:14:51.344232 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:51.343857    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b" podUID="57380917-8312-4d27-b610-ced9e601a8ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 22:14:52.344124 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:52.344093    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 22:14:52.344609 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:52.344153    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b" podUID="57380917-8312-4d27-b610-ced9e601a8ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 22:14:53.343642 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:53.343583    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 22:14:53.343821 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:53.343667    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b" podUID="57380917-8312-4d27-b610-ced9e601a8ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 22:14:54.343948 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:54.343908    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 22:14:54.344428 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:54.343966    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b" podUID="57380917-8312-4d27-b610-ced9e601a8ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 22:14:55.343804 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:55.343771    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 22:14:55.344063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:55.343821    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b" podUID="57380917-8312-4d27-b610-ced9e601a8ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 22:14:55.633782 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:55.633700    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:56.344008 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:56.343967    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 30 22:14:56.344180 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:56.344023    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b" podUID="57380917-8312-4d27-b610-ced9e601a8ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 30 22:14:57.348956 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.348925    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:57.349335 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.349318    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:57.350054 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.350030    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:14:57.686463 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.686369    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"]
Oct 30 22:14:57.692036 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.692013    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.756548 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.756512    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"]
Oct 30 22:14:57.757010 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.756983    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-2a4123\"/\"distinct-2-w0-2a4123-kserve-self-signed-certs\""
Oct 30 22:14:57.826164 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.826125    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-dshm\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.826370 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.826338    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-tmp-dir\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.826370 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.826360    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-model-cache\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.826449 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.826388    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-tls-certs\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.826449 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.826414    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-home\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.826513 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.826485    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rphct\" (UniqueName: \"kubernetes.io/projected/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-kube-api-access-rphct\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.927999 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.927967    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-dshm\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.928184 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.928110    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-tmp-dir\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.928184 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.928133    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-model-cache\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.928184 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.928156    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-tls-certs\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.928299 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.928218    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-home\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.928354 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.928335    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rphct\" (UniqueName: \"kubernetes.io/projected/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-kube-api-access-rphct\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.928526 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.928500    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-model-cache\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.928697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.928578    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-home\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.928697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.928679    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-tmp-dir\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.930374 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.930345    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-dshm\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.930655 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.930637    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-tls-certs\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:57.969974 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.969898    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:57.992239 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:57.992211    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rphct\" (UniqueName: \"kubernetes.io/projected/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-kube-api-access-rphct\") pod \"distinct-2-w0-2a4123-kserve-cffcbf55-74tc4\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") " pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:58.022669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:58.022646    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:14:58.422796 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:58.422768    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"]
Oct 30 22:14:58.426190 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:14:58.426161    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1ab3125_0789_4c58_9b92_fd7f46ed3b0c.slice/crio-444c116fed053c7fd15e690f8e18384f6fddae3a083bdb78f2cd38321dc3bc1d WatchSource:0}: Error finding container 444c116fed053c7fd15e690f8e18384f6fddae3a083bdb78f2cd38321dc3bc1d: Status 404 returned error can't find the container with id 444c116fed053c7fd15e690f8e18384f6fddae3a083bdb78f2cd38321dc3bc1d
Oct 30 22:14:59.248884 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:59.248832    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" event={"ID":"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c","Type":"ContainerStarted","Data":"25ca6fc8e023b87158baf4ad5d0a200cc59e50f5b44a113c543929b3596159b2"}
Oct 30 22:14:59.248884 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:59.248887    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" event={"ID":"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c","Type":"ContainerStarted","Data":"444c116fed053c7fd15e690f8e18384f6fddae3a083bdb78f2cd38321dc3bc1d"}
Oct 30 22:14:59.420623 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:14:59.420548    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podStartSLOduration=2.4205314319999998 podStartE2EDuration="2.420531432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:59.415779456 +0000 UTC m=+1214.146636598" watchObservedRunningTime="2026-10-30 22:14:59.420531432 +0000 UTC m=+1214.151388577"
Oct 30 22:15:00.023779 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.023743    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:15:00.241671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.241634    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"]
Oct 30 22:15:00.246127 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.246103    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"
Oct 30 22:15:00.283156 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.283097    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"]
Oct 30 22:15:00.286971 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.286954    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"
Oct 30 22:15:00.310455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.310430    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l4mjj\""
Oct 30 22:15:00.332392 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.332367    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"]
Oct 30 22:15:00.336393 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.336371    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"
Oct 30 22:15:00.356241 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.356214    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af381bb-eea4-4c49-95ef-d647ec33933d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd\" (UID: \"2af381bb-eea4-4c49-95ef-d647ec33933d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"
Oct 30 22:15:00.356992 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.356969    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjnqv\" (UniqueName: \"kubernetes.io/projected/2af381bb-eea4-4c49-95ef-d647ec33933d-kube-api-access-fjnqv\") pod \"maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd\" (UID: \"2af381bb-eea4-4c49-95ef-d647ec33933d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"
Oct 30 22:15:00.357156 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.357132    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6262fa52-2857-4615-849c-bd3a3759a90b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr\" (UID: \"6262fa52-2857-4615-849c-bd3a3759a90b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"
Oct 30 22:15:00.357295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.357274    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88tmm\" (UniqueName: \"kubernetes.io/projected/6262fa52-2857-4615-849c-bd3a3759a90b-kube-api-access-88tmm\") pod \"maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr\" (UID: \"6262fa52-2857-4615-849c-bd3a3759a90b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"
Oct 30 22:15:00.365388 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.365358    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"]
Oct 30 22:15:00.370469 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.370445    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"]
Oct 30 22:15:00.394253 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.394229    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"]
Oct 30 22:15:00.458459 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.458425    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fcdddac-1f63-4876-becc-a903fe4d2487-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r\" (UID: \"5fcdddac-1f63-4876-becc-a903fe4d2487\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"
Oct 30 22:15:00.458668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.458488    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af381bb-eea4-4c49-95ef-d647ec33933d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd\" (UID: \"2af381bb-eea4-4c49-95ef-d647ec33933d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"
Oct 30 22:15:00.458668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.458585    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn2fk\" (UniqueName: \"kubernetes.io/projected/5fcdddac-1f63-4876-becc-a903fe4d2487-kube-api-access-xn2fk\") pod \"maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r\" (UID: \"5fcdddac-1f63-4876-becc-a903fe4d2487\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"
Oct 30 22:15:00.458809 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.458693    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjnqv\" (UniqueName: \"kubernetes.io/projected/2af381bb-eea4-4c49-95ef-d647ec33933d-kube-api-access-fjnqv\") pod \"maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd\" (UID: \"2af381bb-eea4-4c49-95ef-d647ec33933d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"
Oct 30 22:15:00.458809 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.458724    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6262fa52-2857-4615-849c-bd3a3759a90b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr\" (UID: \"6262fa52-2857-4615-849c-bd3a3759a90b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"
Oct 30 22:15:00.458943 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.458827    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88tmm\" (UniqueName: \"kubernetes.io/projected/6262fa52-2857-4615-849c-bd3a3759a90b-kube-api-access-88tmm\") pod \"maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr\" (UID: \"6262fa52-2857-4615-849c-bd3a3759a90b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"
Oct 30 22:15:00.459337 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.459313    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af381bb-eea4-4c49-95ef-d647ec33933d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd\" (UID: \"2af381bb-eea4-4c49-95ef-d647ec33933d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"
Oct 30 22:15:00.459425 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.459341    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6262fa52-2857-4615-849c-bd3a3759a90b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr\" (UID: \"6262fa52-2857-4615-849c-bd3a3759a90b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"
Oct 30 22:15:00.522736 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.522696    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjnqv\" (UniqueName: \"kubernetes.io/projected/2af381bb-eea4-4c49-95ef-d647ec33933d-kube-api-access-fjnqv\") pod \"maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd\" (UID: \"2af381bb-eea4-4c49-95ef-d647ec33933d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"
Oct 30 22:15:00.522949 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.522932    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88tmm\" (UniqueName: \"kubernetes.io/projected/6262fa52-2857-4615-849c-bd3a3759a90b-kube-api-access-88tmm\") pod \"maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr\" (UID: \"6262fa52-2857-4615-849c-bd3a3759a90b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"
Oct 30 22:15:00.560451 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.560424    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fcdddac-1f63-4876-becc-a903fe4d2487-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r\" (UID: \"5fcdddac-1f63-4876-becc-a903fe4d2487\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"
Oct 30 22:15:00.560563 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.560530    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn2fk\" (UniqueName: \"kubernetes.io/projected/5fcdddac-1f63-4876-becc-a903fe4d2487-kube-api-access-xn2fk\") pod \"maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r\" (UID: \"5fcdddac-1f63-4876-becc-a903fe4d2487\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"
Oct 30 22:15:00.560633 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.560584    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"
Oct 30 22:15:00.561001 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.560983    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fcdddac-1f63-4876-becc-a903fe4d2487-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r\" (UID: \"5fcdddac-1f63-4876-becc-a903fe4d2487\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"
Oct 30 22:15:00.600297 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.600273    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"
Oct 30 22:15:00.629170 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.628886    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn2fk\" (UniqueName: \"kubernetes.io/projected/5fcdddac-1f63-4876-becc-a903fe4d2487-kube-api-access-xn2fk\") pod \"maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r\" (UID: \"5fcdddac-1f63-4876-becc-a903fe4d2487\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"
Oct 30 22:15:00.659922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.653051    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"
Oct 30 22:15:00.962058 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:00.961982    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"]
Oct 30 22:15:00.966100 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:15:00.966057    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af381bb_eea4_4c49_95ef_d647ec33933d.slice/crio-b9d0c5421c7d81ba8ba34fa2a17c90c501b32d625afd5957849a2c0a5be0beeb WatchSource:0}: Error finding container b9d0c5421c7d81ba8ba34fa2a17c90c501b32d625afd5957849a2c0a5be0beeb: Status 404 returned error can't find the container with id b9d0c5421c7d81ba8ba34fa2a17c90c501b32d625afd5957849a2c0a5be0beeb
Oct 30 22:15:01.008995 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:01.008945    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:01.028554 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:01.028530    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"]
Oct 30 22:15:01.028883 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:15:01.028862    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6262fa52_2857_4615_849c_bd3a3759a90b.slice/crio-bc97690f7d86dcb5c86a930b1e18576732ccae611dab3e9627a00a4991c7f1bf WatchSource:0}: Error finding container bc97690f7d86dcb5c86a930b1e18576732ccae611dab3e9627a00a4991c7f1bf: Status 404 returned error can't find the container with id bc97690f7d86dcb5c86a930b1e18576732ccae611dab3e9627a00a4991c7f1bf
Oct 30 22:15:01.080687 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:01.080655    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"]
Oct 30 22:15:01.081793 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:15:01.081769    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fcdddac_1f63_4876_becc_a903fe4d2487.slice/crio-55495a82622b8f606ca815e6943939122188278b1a1e7f85c41193d4bafdac67 WatchSource:0}: Error finding container 55495a82622b8f606ca815e6943939122188278b1a1e7f85c41193d4bafdac67: Status 404 returned error can't find the container with id 55495a82622b8f606ca815e6943939122188278b1a1e7f85c41193d4bafdac67
Oct 30 22:15:01.264271 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:01.264185    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r" event={"ID":"5fcdddac-1f63-4876-becc-a903fe4d2487","Type":"ContainerStarted","Data":"55495a82622b8f606ca815e6943939122188278b1a1e7f85c41193d4bafdac67"}
Oct 30 22:15:01.265554 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:01.265531    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr" event={"ID":"6262fa52-2857-4615-849c-bd3a3759a90b","Type":"ContainerStarted","Data":"bc97690f7d86dcb5c86a930b1e18576732ccae611dab3e9627a00a4991c7f1bf"}
Oct 30 22:15:01.266841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:01.266818    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd" event={"ID":"2af381bb-eea4-4c49-95ef-d647ec33933d","Type":"ContainerStarted","Data":"b9d0c5421c7d81ba8ba34fa2a17c90c501b32d625afd5957849a2c0a5be0beeb"}
Oct 30 22:15:02.275772 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:02.275728    5258 generic.go:356] "Generic (PLEG): container finished" podID="5fcdddac-1f63-4876-becc-a903fe4d2487" containerID="bdada55027898ac0907e04cbc1b6e6289a6c974ce87cf7c381232c26d32c08fb" exitCode=60
Oct 30 22:15:02.276210 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:02.275819    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r" event={"ID":"5fcdddac-1f63-4876-becc-a903fe4d2487","Type":"ContainerDied","Data":"bdada55027898ac0907e04cbc1b6e6289a6c974ce87cf7c381232c26d32c08fb"}
Oct 30 22:15:02.276210 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:02.276114    5258 scope.go:122] "RemoveContainer" containerID="bdada55027898ac0907e04cbc1b6e6289a6c974ce87cf7c381232c26d32c08fb"
Oct 30 22:15:02.277669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:02.277643    5258 generic.go:356] "Generic (PLEG): container finished" podID="6262fa52-2857-4615-849c-bd3a3759a90b" containerID="1cfa7edc80791e6595b2d0dfaa32cb420997211f05a7134531244bb9050950e8" exitCode=60
Oct 30 22:15:02.277790 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:02.277745    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr" event={"ID":"6262fa52-2857-4615-849c-bd3a3759a90b","Type":"ContainerDied","Data":"1cfa7edc80791e6595b2d0dfaa32cb420997211f05a7134531244bb9050950e8"}
Oct 30 22:15:02.277956 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:02.277938    5258 scope.go:122] "RemoveContainer" containerID="1cfa7edc80791e6595b2d0dfaa32cb420997211f05a7134531244bb9050950e8"
Oct 30 22:15:02.280419 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:02.280394    5258 generic.go:356] "Generic (PLEG): container finished" podID="2af381bb-eea4-4c49-95ef-d647ec33933d" containerID="d20e94ac586e96246d10a982ee5ae75ace9c48963dfe85ae87d0f9b0051c88be" exitCode=60
Oct 30 22:15:02.280530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:02.280488    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd" event={"ID":"2af381bb-eea4-4c49-95ef-d647ec33933d","Type":"ContainerDied","Data":"d20e94ac586e96246d10a982ee5ae75ace9c48963dfe85ae87d0f9b0051c88be"}
Oct 30 22:15:02.280768 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:02.280752    5258 scope.go:122] "RemoveContainer" containerID="d20e94ac586e96246d10a982ee5ae75ace9c48963dfe85ae87d0f9b0051c88be"
Oct 30 22:15:03.289707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:03.289672    5258 generic.go:356] "Generic (PLEG): container finished" podID="5fcdddac-1f63-4876-becc-a903fe4d2487" containerID="cdeb326245549a88d07cbff25f0d5a3b030301a8ba8aa7f44acd0030cacbd9dc" exitCode=60
Oct 30 22:15:03.290179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:03.289761    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r" event={"ID":"5fcdddac-1f63-4876-becc-a903fe4d2487","Type":"ContainerDied","Data":"cdeb326245549a88d07cbff25f0d5a3b030301a8ba8aa7f44acd0030cacbd9dc"}
Oct 30 22:15:03.290179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:03.289834    5258 scope.go:122] "RemoveContainer" containerID="bdada55027898ac0907e04cbc1b6e6289a6c974ce87cf7c381232c26d32c08fb"
Oct 30 22:15:03.290414 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:03.290295    5258 scope.go:122] "RemoveContainer" containerID="cdeb326245549a88d07cbff25f0d5a3b030301a8ba8aa7f44acd0030cacbd9dc"
Oct 30 22:15:03.291069 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:15:03.291040    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r_odh-ai-gateway-infra(5fcdddac-1f63-4876-becc-a903fe4d2487)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r" podUID="5fcdddac-1f63-4876-becc-a903fe4d2487"
Oct 30 22:15:03.292694 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:03.292674    5258 generic.go:356] "Generic (PLEG): container finished" podID="6262fa52-2857-4615-849c-bd3a3759a90b" containerID="6bfccec6b348a5c87f0981039f12fd3dd545525a2ee0a35b2ca9c2f55fb99bdc" exitCode=60
Oct 30 22:15:03.292802 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:03.292753    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr" event={"ID":"6262fa52-2857-4615-849c-bd3a3759a90b","Type":"ContainerDied","Data":"6bfccec6b348a5c87f0981039f12fd3dd545525a2ee0a35b2ca9c2f55fb99bdc"}
Oct 30 22:15:03.293029 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:03.293015    5258 scope.go:122] "RemoveContainer" containerID="6bfccec6b348a5c87f0981039f12fd3dd545525a2ee0a35b2ca9c2f55fb99bdc"
Oct 30 22:15:03.293331 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:15:03.293305    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr_odh-ai-gateway-infra(6262fa52-2857-4615-849c-bd3a3759a90b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr" podUID="6262fa52-2857-4615-849c-bd3a3759a90b"
Oct 30 22:15:03.294804 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:03.294783    5258 generic.go:356] "Generic (PLEG): container finished" podID="2af381bb-eea4-4c49-95ef-d647ec33933d" containerID="8c35793b237b48feed69d6e0c8fcb683cebe1377b65c5b1ac3f1fd4f76889a3f" exitCode=60
Oct 30 22:15:03.294903 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:03.294858    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd" event={"ID":"2af381bb-eea4-4c49-95ef-d647ec33933d","Type":"ContainerDied","Data":"8c35793b237b48feed69d6e0c8fcb683cebe1377b65c5b1ac3f1fd4f76889a3f"}
Oct 30 22:15:03.295108 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:03.295096    5258 scope.go:122] "RemoveContainer" containerID="8c35793b237b48feed69d6e0c8fcb683cebe1377b65c5b1ac3f1fd4f76889a3f"
Oct 30 22:15:03.295340 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:15:03.295325    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd_odh-ai-gateway-infra(2af381bb-eea4-4c49-95ef-d647ec33933d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd" podUID="2af381bb-eea4-4c49-95ef-d647ec33933d"
Oct 30 22:15:03.348859 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:03.348836    5258 scope.go:122] "RemoveContainer" containerID="1cfa7edc80791e6595b2d0dfaa32cb420997211f05a7134531244bb9050950e8"
Oct 30 22:15:03.361923 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:03.361902    5258 scope.go:122] "RemoveContainer" containerID="d20e94ac586e96246d10a982ee5ae75ace9c48963dfe85ae87d0f9b0051c88be"
Oct 30 22:15:04.305713 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:04.305687    5258 scope.go:122] "RemoveContainer" containerID="8c35793b237b48feed69d6e0c8fcb683cebe1377b65c5b1ac3f1fd4f76889a3f"
Oct 30 22:15:04.306213 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:15:04.306065    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd_odh-ai-gateway-infra(2af381bb-eea4-4c49-95ef-d647ec33933d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd" podUID="2af381bb-eea4-4c49-95ef-d647ec33933d"
Oct 30 22:15:04.307360 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:04.307338    5258 scope.go:122] "RemoveContainer" containerID="cdeb326245549a88d07cbff25f0d5a3b030301a8ba8aa7f44acd0030cacbd9dc"
Oct 30 22:15:04.307655 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:15:04.307626    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r_odh-ai-gateway-infra(5fcdddac-1f63-4876-becc-a903fe4d2487)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r" podUID="5fcdddac-1f63-4876-becc-a903fe4d2487"
Oct 30 22:15:04.308901 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:04.308883    5258 scope.go:122] "RemoveContainer" containerID="6bfccec6b348a5c87f0981039f12fd3dd545525a2ee0a35b2ca9c2f55fb99bdc"
Oct 30 22:15:04.309121 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:15:04.309103    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr_odh-ai-gateway-infra(6262fa52-2857-4615-849c-bd3a3759a90b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr" podUID="6262fa52-2857-4615-849c-bd3a3759a90b"
Oct 30 22:15:06.371341 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:06.371306    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:08.023628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:08.023584    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:15:08.037007 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:08.036984    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:15:08.349454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:08.349422    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:15:09.850042 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:09.850004    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:15:11.592247 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:11.592208    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:13.162701 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:15:13.162662    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:15:15.378288 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:15.378258    5258 scope.go:122] "RemoveContainer" containerID="8c35793b237b48feed69d6e0c8fcb683cebe1377b65c5b1ac3f1fd4f76889a3f"
Oct 30 22:15:15.378734 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:15.378331    5258 scope.go:122] "RemoveContainer" containerID="6bfccec6b348a5c87f0981039f12fd3dd545525a2ee0a35b2ca9c2f55fb99bdc"
Oct 30 22:15:16.403070 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:16.403040    5258 generic.go:356] "Generic (PLEG): container finished" podID="6262fa52-2857-4615-849c-bd3a3759a90b" containerID="5aacae875be8b2ad664f078ffc412d6f5caaa2b1a7d0952a444beaa65fff4356" exitCode=60
Oct 30 22:15:16.403462 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:16.403119    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr" event={"ID":"6262fa52-2857-4615-849c-bd3a3759a90b","Type":"ContainerDied","Data":"5aacae875be8b2ad664f078ffc412d6f5caaa2b1a7d0952a444beaa65fff4356"}
Oct 30 22:15:16.403462 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:16.403184    5258 scope.go:122] "RemoveContainer" containerID="6bfccec6b348a5c87f0981039f12fd3dd545525a2ee0a35b2ca9c2f55fb99bdc"
Oct 30 22:15:16.403615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:16.403551    5258 scope.go:122] "RemoveContainer" containerID="5aacae875be8b2ad664f078ffc412d6f5caaa2b1a7d0952a444beaa65fff4356"
Oct 30 22:15:16.403930 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:15:16.403896    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr_odh-ai-gateway-infra(6262fa52-2857-4615-849c-bd3a3759a90b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr" podUID="6262fa52-2857-4615-849c-bd3a3759a90b"
Oct 30 22:15:16.405334 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:16.405313    5258 generic.go:356] "Generic (PLEG): container finished" podID="2af381bb-eea4-4c49-95ef-d647ec33933d" containerID="92f4df4be5ed2364becefea0b5d9158f95614905b99b282e79e91b9786f488d2" exitCode=60
Oct 30 22:15:16.405426 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:16.405361    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd" event={"ID":"2af381bb-eea4-4c49-95ef-d647ec33933d","Type":"ContainerDied","Data":"92f4df4be5ed2364becefea0b5d9158f95614905b99b282e79e91b9786f488d2"}
Oct 30 22:15:16.405708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:16.405695    5258 scope.go:122] "RemoveContainer" containerID="92f4df4be5ed2364becefea0b5d9158f95614905b99b282e79e91b9786f488d2"
Oct 30 22:15:16.405938 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:15:16.405922    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd_odh-ai-gateway-infra(2af381bb-eea4-4c49-95ef-d647ec33933d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd" podUID="2af381bb-eea4-4c49-95ef-d647ec33933d"
Oct 30 22:15:16.416092 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:16.416069    5258 scope.go:122] "RemoveContainer" containerID="8c35793b237b48feed69d6e0c8fcb683cebe1377b65c5b1ac3f1fd4f76889a3f"
Oct 30 22:15:16.918693 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:16.918659    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:17.385635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.373361    5258 scope.go:122] "RemoveContainer" containerID="cdeb326245549a88d07cbff25f0d5a3b030301a8ba8aa7f44acd0030cacbd9dc"
Oct 30 22:15:17.552928 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.552898    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"]
Oct 30 22:15:17.693240 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.693154    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"]
Oct 30 22:15:17.749960 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.749934    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"
Oct 30 22:15:17.872784 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.872747    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6262fa52-2857-4615-849c-bd3a3759a90b-kube-api-access-88tmm\" (UniqueName: \"kubernetes.io/projected/6262fa52-2857-4615-849c-bd3a3759a90b-kube-api-access-88tmm\") pod \"6262fa52-2857-4615-849c-bd3a3759a90b\" (UID: \"6262fa52-2857-4615-849c-bd3a3759a90b\") "
Oct 30 22:15:17.873095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.873069    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6262fa52-2857-4615-849c-bd3a3759a90b-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6262fa52-2857-4615-849c-bd3a3759a90b-maas-api-service-ca\") pod \"6262fa52-2857-4615-849c-bd3a3759a90b\" (UID: \"6262fa52-2857-4615-849c-bd3a3759a90b\") "
Oct 30 22:15:17.873508 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.873479    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6262fa52-2857-4615-849c-bd3a3759a90b-maas-api-service-ca" pod "6262fa52-2857-4615-849c-bd3a3759a90b" (UID: "6262fa52-2857-4615-849c-bd3a3759a90b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:17.873902 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.873687    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6262fa52-2857-4615-849c-bd3a3759a90b-maas-api-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:17.874998 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.874970    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6262fa52-2857-4615-849c-bd3a3759a90b-kube-api-access-88tmm" pod "6262fa52-2857-4615-849c-bd3a3759a90b" (UID: "6262fa52-2857-4615-849c-bd3a3759a90b"). InnerVolumeSpecName "kube-api-access-88tmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:17.876380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.876363    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"
Oct 30 22:15:17.974987 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.974919    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2af381bb-eea4-4c49-95ef-d647ec33933d-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af381bb-eea4-4c49-95ef-d647ec33933d-maas-api-service-ca\") pod \"2af381bb-eea4-4c49-95ef-d647ec33933d\" (UID: \"2af381bb-eea4-4c49-95ef-d647ec33933d\") "
Oct 30 22:15:17.975132 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.975015    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2af381bb-eea4-4c49-95ef-d647ec33933d-kube-api-access-fjnqv\" (UniqueName: \"kubernetes.io/projected/2af381bb-eea4-4c49-95ef-d647ec33933d-kube-api-access-fjnqv\") pod \"2af381bb-eea4-4c49-95ef-d647ec33933d\" (UID: \"2af381bb-eea4-4c49-95ef-d647ec33933d\") "
Oct 30 22:15:17.975252 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.975230    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af381bb-eea4-4c49-95ef-d647ec33933d-maas-api-service-ca" pod "2af381bb-eea4-4c49-95ef-d647ec33933d" (UID: "2af381bb-eea4-4c49-95ef-d647ec33933d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:17.975456 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.975442    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af381bb-eea4-4c49-95ef-d647ec33933d-maas-api-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:17.975514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.975458    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88tmm\" (UniqueName: \"kubernetes.io/projected/6262fa52-2857-4615-849c-bd3a3759a90b-kube-api-access-88tmm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:17.977083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:17.977060    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2af381bb-eea4-4c49-95ef-d647ec33933d-kube-api-access-fjnqv" pod "2af381bb-eea4-4c49-95ef-d647ec33933d" (UID: "2af381bb-eea4-4c49-95ef-d647ec33933d"). InnerVolumeSpecName "kube-api-access-fjnqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:18.077305 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.077268    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjnqv\" (UniqueName: \"kubernetes.io/projected/2af381bb-eea4-4c49-95ef-d647ec33933d-kube-api-access-fjnqv\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:18.426349 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.426321    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"
Oct 30 22:15:18.426492 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.426357    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd" event={"ID":"2af381bb-eea4-4c49-95ef-d647ec33933d","Type":"ContainerDied","Data":"b9d0c5421c7d81ba8ba34fa2a17c90c501b32d625afd5957849a2c0a5be0beeb"}
Oct 30 22:15:18.426492 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.426424    5258 scope.go:122] "RemoveContainer" containerID="92f4df4be5ed2364becefea0b5d9158f95614905b99b282e79e91b9786f488d2"
Oct 30 22:15:18.428740 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.428711    5258 generic.go:356] "Generic (PLEG): container finished" podID="5fcdddac-1f63-4876-becc-a903fe4d2487" containerID="4a1e49037d78943312b162567e8d0fde327ee15f4b7b75fb7396a47d39661670" exitCode=60
Oct 30 22:15:18.428851 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.428744    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r" event={"ID":"5fcdddac-1f63-4876-becc-a903fe4d2487","Type":"ContainerDied","Data":"4a1e49037d78943312b162567e8d0fde327ee15f4b7b75fb7396a47d39661670"}
Oct 30 22:15:18.429175 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.429154    5258 scope.go:122] "RemoveContainer" containerID="4a1e49037d78943312b162567e8d0fde327ee15f4b7b75fb7396a47d39661670"
Oct 30 22:15:18.429462 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:15:18.429437    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r_odh-ai-gateway-infra(5fcdddac-1f63-4876-becc-a903fe4d2487)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r" podUID="5fcdddac-1f63-4876-becc-a903fe4d2487"
Oct 30 22:15:18.430255 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.430239    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"
Oct 30 22:15:18.430334 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.430282    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr" event={"ID":"6262fa52-2857-4615-849c-bd3a3759a90b","Type":"ContainerDied","Data":"bc97690f7d86dcb5c86a930b1e18576732ccae611dab3e9627a00a4991c7f1bf"}
Oct 30 22:15:18.438422 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.438402    5258 scope.go:122] "RemoveContainer" containerID="cdeb326245549a88d07cbff25f0d5a3b030301a8ba8aa7f44acd0030cacbd9dc"
Oct 30 22:15:18.451145 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.451115    5258 scope.go:122] "RemoveContainer" containerID="5aacae875be8b2ad664f078ffc412d6f5caaa2b1a7d0952a444beaa65fff4356"
Oct 30 22:15:18.597093 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.597065    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"]
Oct 30 22:15:18.603956 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.603931    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-97aa64-29889975-hr5dd"]
Oct 30 22:15:18.835631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.835562    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"]
Oct 30 22:15:18.838913 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:18.838892    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889975-8fgrr"]
Oct 30 22:15:19.399226 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:19.399186    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2af381bb-eea4-4c49-95ef-d647ec33933d" path="/var/lib/kubelet/pods/2af381bb-eea4-4c49-95ef-d647ec33933d/volumes"
Oct 30 22:15:19.399827 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:19.399803    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6262fa52-2857-4615-849c-bd3a3759a90b" path="/var/lib/kubelet/pods/6262fa52-2857-4615-849c-bd3a3759a90b/volumes"
Oct 30 22:15:19.742832 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:19.742740    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"]
Oct 30 22:15:19.914405 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:19.914382    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"
Oct 30 22:15:20.006639 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:20.006547    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5fcdddac-1f63-4876-becc-a903fe4d2487-kube-api-access-xn2fk\" (UniqueName: \"kubernetes.io/projected/5fcdddac-1f63-4876-becc-a903fe4d2487-kube-api-access-xn2fk\") pod \"5fcdddac-1f63-4876-becc-a903fe4d2487\" (UID: \"5fcdddac-1f63-4876-becc-a903fe4d2487\") "
Oct 30 22:15:20.006771 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:20.006679    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5fcdddac-1f63-4876-becc-a903fe4d2487-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fcdddac-1f63-4876-becc-a903fe4d2487-maas-api-service-ca\") pod \"5fcdddac-1f63-4876-becc-a903fe4d2487\" (UID: \"5fcdddac-1f63-4876-becc-a903fe4d2487\") "
Oct 30 22:15:20.007012 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:20.006989    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fcdddac-1f63-4876-becc-a903fe4d2487-maas-api-service-ca" pod "5fcdddac-1f63-4876-becc-a903fe4d2487" (UID: "5fcdddac-1f63-4876-becc-a903fe4d2487"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:20.008908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:20.008881    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fcdddac-1f63-4876-becc-a903fe4d2487-kube-api-access-xn2fk" pod "5fcdddac-1f63-4876-becc-a903fe4d2487" (UID: "5fcdddac-1f63-4876-becc-a903fe4d2487"). InnerVolumeSpecName "kube-api-access-xn2fk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:20.108417 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:20.108375    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn2fk\" (UniqueName: \"kubernetes.io/projected/5fcdddac-1f63-4876-becc-a903fe4d2487-kube-api-access-xn2fk\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:20.108554 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:20.108422    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fcdddac-1f63-4876-becc-a903fe4d2487-maas-api-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:20.447975 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:20.447939    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r" event={"ID":"5fcdddac-1f63-4876-becc-a903fe4d2487","Type":"ContainerDied","Data":"55495a82622b8f606ca815e6943939122188278b1a1e7f85c41193d4bafdac67"}
Oct 30 22:15:20.448193 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:20.448010    5258 scope.go:122] "RemoveContainer" containerID="4a1e49037d78943312b162567e8d0fde327ee15f4b7b75fb7396a47d39661670"
Oct 30 22:15:20.448193 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:20.447949    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"
Oct 30 22:15:20.618492 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:20.618460    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"]
Oct 30 22:15:20.669090 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:20.669047    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2a4123-29889975-5kf9r"]
Oct 30 22:15:21.387486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:21.387452    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5fcdddac-1f63-4876-becc-a903fe4d2487" path="/var/lib/kubelet/pods/5fcdddac-1f63-4876-becc-a903fe4d2487/volumes"
Oct 30 22:15:22.138690 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:22.138655    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:22.446783 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:22.446699    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:27.302364 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:27.302323    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:32.399985 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:32.399945    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:36.570578 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:36.570540    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:37.688879 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:37.688845    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:40.784735 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:40.784698    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:15:42.786059 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:42.786026    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:43.161662 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:15:43.161624    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:15:47.962261 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:47.962222    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:50.110938 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:50.110901    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:53.055413 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:53.055375    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:57.114051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.113974    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"]
Oct 30 22:15:57.114617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114576    5258 cpu_manager.go:414] "containerMap: removing container" podUID="6262fa52-2857-4615-849c-bd3a3759a90b" containerName="cleanup"
Oct 30 22:15:57.114617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114614    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6262fa52-2857-4615-849c-bd3a3759a90b" containerName="cleanup"
Oct 30 22:15:57.114720 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114655    5258 cpu_manager.go:414] "containerMap: removing container" podUID="2af381bb-eea4-4c49-95ef-d647ec33933d" containerName="cleanup"
Oct 30 22:15:57.114720 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114661    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2af381bb-eea4-4c49-95ef-d647ec33933d" containerName="cleanup"
Oct 30 22:15:57.114720 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114671    5258 cpu_manager.go:414] "containerMap: removing container" podUID="5fcdddac-1f63-4876-becc-a903fe4d2487" containerName="cleanup"
Oct 30 22:15:57.114720 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114676    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fcdddac-1f63-4876-becc-a903fe4d2487" containerName="cleanup"
Oct 30 22:15:57.114720 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114685    5258 cpu_manager.go:414] "containerMap: removing container" podUID="5fcdddac-1f63-4876-becc-a903fe4d2487" containerName="cleanup"
Oct 30 22:15:57.114720 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114689    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fcdddac-1f63-4876-becc-a903fe4d2487" containerName="cleanup"
Oct 30 22:15:57.114720 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114698    5258 cpu_manager.go:414] "containerMap: removing container" podUID="2af381bb-eea4-4c49-95ef-d647ec33933d" containerName="cleanup"
Oct 30 22:15:57.114720 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114702    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2af381bb-eea4-4c49-95ef-d647ec33933d" containerName="cleanup"
Oct 30 22:15:57.114720 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114711    5258 cpu_manager.go:414] "containerMap: removing container" podUID="6262fa52-2857-4615-849c-bd3a3759a90b" containerName="cleanup"
Oct 30 22:15:57.114720 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114716    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6262fa52-2857-4615-849c-bd3a3759a90b" containerName="cleanup"
Oct 30 22:15:57.115013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114733    5258 cpu_manager.go:414] "containerMap: removing container" podUID="6262fa52-2857-4615-849c-bd3a3759a90b" containerName="cleanup"
Oct 30 22:15:57.115013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114738    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6262fa52-2857-4615-849c-bd3a3759a90b" containerName="cleanup"
Oct 30 22:15:57.115013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114835    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="6262fa52-2857-4615-849c-bd3a3759a90b" containerName="cleanup"
Oct 30 22:15:57.115013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114845    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="2af381bb-eea4-4c49-95ef-d647ec33933d" containerName="cleanup"
Oct 30 22:15:57.115013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114851    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="5fcdddac-1f63-4876-becc-a903fe4d2487" containerName="cleanup"
Oct 30 22:15:57.115013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114857    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="5fcdddac-1f63-4876-becc-a903fe4d2487" containerName="cleanup"
Oct 30 22:15:57.115013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114862    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="2af381bb-eea4-4c49-95ef-d647ec33933d" containerName="cleanup"
Oct 30 22:15:57.115013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.114871    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="6262fa52-2857-4615-849c-bd3a3759a90b" containerName="cleanup"
Oct 30 22:15:57.119711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.119691    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.219453 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.219415    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"]
Oct 30 22:15:57.223141 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.223115    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-97aa64\"/\"distinct-2-w4-97aa64-kserve-self-signed-certs\""
Oct 30 22:15:57.268748 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.268713    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-model-cache\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.268968 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.268795    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9f5h\" (UniqueName: \"kubernetes.io/projected/691a53b3-2708-4de9-b5c5-e0a7b322e899-kube-api-access-w9f5h\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.268968 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.268915    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-dshm\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.269103 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.268976    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/691a53b3-2708-4de9-b5c5-e0a7b322e899-tls-certs\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.269103 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.269055    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-home\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.269205 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.269159    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-tmp-dir\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.304836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.304802    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:57.370408 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.370313    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-home\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.370608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.370407    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-tmp-dir\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.370608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.370547    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-model-cache\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.370747 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.370618    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9f5h\" (UniqueName: \"kubernetes.io/projected/691a53b3-2708-4de9-b5c5-e0a7b322e899-kube-api-access-w9f5h\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.370747 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.370669    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-dshm\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.370747 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.370722    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/691a53b3-2708-4de9-b5c5-e0a7b322e899-tls-certs\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.370895 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.370803    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-home\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.370895 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.370831    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-tmp-dir\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.371063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.371043    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-model-cache\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.373251 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.373182    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-dshm\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.373577 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.373554    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/691a53b3-2708-4de9-b5c5-e0a7b322e899-tls-certs\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.439017 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.438983    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9f5h\" (UniqueName: \"kubernetes.io/projected/691a53b3-2708-4de9-b5c5-e0a7b322e899-kube-api-access-w9f5h\") pod \"distinct-2-w4-97aa64-kserve-596598b778-5kqxx\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") " pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:57.734905 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:57.734825    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:58.111665 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:58.111620    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:58.125380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:58.125351    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"]
Oct 30 22:15:58.127052 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:15:58.127027    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod691a53b3_2708_4de9_b5c5_e0a7b322e899.slice/crio-7832370781e4ed7b50f8c6d053d13c35346d97953af727f18ac7d3c321b85f3c WatchSource:0}: Error finding container 7832370781e4ed7b50f8c6d053d13c35346d97953af727f18ac7d3c321b85f3c: Status 404 returned error can't find the container with id 7832370781e4ed7b50f8c6d053d13c35346d97953af727f18ac7d3c321b85f3c
Oct 30 22:15:58.753363 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:58.753321    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" event={"ID":"691a53b3-2708-4de9-b5c5-e0a7b322e899","Type":"ContainerStarted","Data":"96a7fb740392674d78f455dbb02c52d045ec35cbd4ed4306642ad1b5b9df0478"}
Oct 30 22:15:58.753545 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:58.753378    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" event={"ID":"691a53b3-2708-4de9-b5c5-e0a7b322e899","Type":"ContainerStarted","Data":"7832370781e4ed7b50f8c6d053d13c35346d97953af727f18ac7d3c321b85f3c"}
Oct 30 22:15:58.877994 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:58.877943    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podStartSLOduration=1.87792854 podStartE2EDuration="1.87792854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:58.874393351 +0000 UTC m=+1273.605250494" watchObservedRunningTime="2026-10-30 22:15:58.87792854 +0000 UTC m=+1273.608785662"
Oct 30 22:15:59.735268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.735233    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:15:59.830372 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.830338    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"]
Oct 30 22:15:59.831061 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.831041    5258 cpu_manager.go:414] "containerMap: removing container" podUID="5fcdddac-1f63-4876-becc-a903fe4d2487" containerName="cleanup"
Oct 30 22:15:59.831061 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.831061    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fcdddac-1f63-4876-becc-a903fe4d2487" containerName="cleanup"
Oct 30 22:15:59.831258 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.831078    5258 cpu_manager.go:414] "containerMap: removing container" podUID="2af381bb-eea4-4c49-95ef-d647ec33933d" containerName="cleanup"
Oct 30 22:15:59.831258 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.831086    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2af381bb-eea4-4c49-95ef-d647ec33933d" containerName="cleanup"
Oct 30 22:15:59.831258 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.831222    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="5fcdddac-1f63-4876-becc-a903fe4d2487" containerName="cleanup"
Oct 30 22:15:59.831258 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.831236    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="2af381bb-eea4-4c49-95ef-d647ec33933d" containerName="cleanup"
Oct 30 22:15:59.831258 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.831258    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="6262fa52-2857-4615-849c-bd3a3759a90b" containerName="cleanup"
Oct 30 22:15:59.835085 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.835065    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:15:59.906738 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.906706    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-workload-certs\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:15:59.906914 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.906843    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-workload-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:15:59.906914 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.906877    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-envoy\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:15:59.907023 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.906938    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-podinfo\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:15:59.907077 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.907060    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-token\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:15:59.907122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.907106    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af4edd7-4096-4c60-bd9f-c24610207d8e-istiod-ca-cert\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:15:59.907269 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.907253    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-credential-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:15:59.907343 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.907313    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-data\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:15:59.907395 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.907373    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbnc5\" (UniqueName: \"kubernetes.io/projected/8af4edd7-4096-4c60-bd9f-c24610207d8e-kube-api-access-lbnc5\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:15:59.940823 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:15:59.940794    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"]
Oct 30 22:16:00.008555 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.008483    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-data\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.008555 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.008517    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbnc5\" (UniqueName: \"kubernetes.io/projected/8af4edd7-4096-4c60-bd9f-c24610207d8e-kube-api-access-lbnc5\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.008761 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.008709    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-workload-certs\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.008819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.008775    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-workload-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.008819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.008793    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-envoy\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.008925 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.008832    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-podinfo\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.008925 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.008902    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-token\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.009074 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.008937    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af4edd7-4096-4c60-bd9f-c24610207d8e-istiod-ca-cert\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.009137 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.009073    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-credential-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.009137 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.009127    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-workload-certs\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.009549 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.009520    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-data\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.009837 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.009810    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af4edd7-4096-4c60-bd9f-c24610207d8e-istiod-ca-cert\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.010032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.010011    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-workload-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.010115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.010014    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-credential-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.011149 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.011121    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-envoy\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.011296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.011274    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-podinfo\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.071356 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.071331    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-token\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.071560 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.071536    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbnc5\" (UniqueName: \"kubernetes.io/projected/8af4edd7-4096-4c60-bd9f-c24610207d8e-kube-api-access-lbnc5\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.150264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.150228    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:00.595227 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.594266    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"]
Oct 30 22:16:00.657492 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:16:00.657463    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af4edd7_4096_4c60_bd9f_c24610207d8e.slice/crio-9f6a8710e1020fae96bcd028094fba144d326c635cb4ce633e4ed933e4d4760e WatchSource:0}: Error finding container 9f6a8710e1020fae96bcd028094fba144d326c635cb4ce633e4ed933e4d4760e: Status 404 returned error can't find the container with id 9f6a8710e1020fae96bcd028094fba144d326c635cb4ce633e4ed933e4d4760e
Oct 30 22:16:00.680874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.680831    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:16:00.684528 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.684482    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:16:00.701819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.701775    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:16:00.773169 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:00.773129    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r" event={"ID":"8af4edd7-4096-4c60-bd9f-c24610207d8e","Type":"ContainerStarted","Data":"9f6a8710e1020fae96bcd028094fba144d326c635cb4ce633e4ed933e4d4760e"}
Oct 30 22:16:01.975614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:01.971793    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r" event={"ID":"8af4edd7-4096-4c60-bd9f-c24610207d8e","Type":"ContainerStarted","Data":"07ff0129421b96b5e450ebc9745960d79fc2b57a22dddb131cc8cf61d850efe3"}
Oct 30 22:16:02.168616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:02.163910    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:02.168616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:02.164050    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 22:16:02.168616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:02.164107    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r" podUID="8af4edd7-4096-4c60-bd9f-c24610207d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 22:16:02.175249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:02.175189    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r" podStartSLOduration=3.175171601 podStartE2EDuration="3.175171601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:02.165930043 +0000 UTC m=+1276.896787187" watchObservedRunningTime="2026-10-30 22:16:02.175171601 +0000 UTC m=+1276.906028746"
Oct 30 22:16:03.156977 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:03.156937    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 22:16:03.157568 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:03.157532    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r" podUID="8af4edd7-4096-4c60-bd9f-c24610207d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 22:16:03.337909 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:03.337875    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:04.152756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:04.152721    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 22:16:04.153019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:04.152991    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r" podUID="8af4edd7-4096-4c60-bd9f-c24610207d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 22:16:05.151313 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:05.150885    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 22:16:05.151313 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:05.150953    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r" podUID="8af4edd7-4096-4c60-bd9f-c24610207d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 22:16:05.296568 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:05.296531    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:06.154927 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:06.154889    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 22:16:06.155491 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:06.155458    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r" podUID="8af4edd7-4096-4c60-bd9f-c24610207d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 22:16:07.154338 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:07.154298    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 22:16:07.154650 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:07.154616    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r" podUID="8af4edd7-4096-4c60-bd9f-c24610207d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 22:16:07.735123 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:07.735089    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:16:07.748247 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:07.748226    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:16:08.054851 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:08.054764    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:16:08.330010 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:08.329970    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:08.611323 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:08.611235    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:08.611706 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:08.611685    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:08.612729 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:08.612702    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:16:11.138098 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.138049    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"]
Oct 30 22:16:11.142507 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.142482    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.203122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.203089    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"]
Oct 30 22:16:11.245321 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.245284    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-tmp-dir\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.245513 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.245447    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-dshm\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.245579 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.245531    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-home\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.245579 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.245559    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef98472f-83c5-490b-b4ea-57077ea8c8d4-tls-certs\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.245730 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.245699    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djdgz\" (UniqueName: \"kubernetes.io/projected/ef98472f-83c5-490b-b4ea-57077ea8c8d4-kube-api-access-djdgz\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.245787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.245769    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-model-cache\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.247180 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.247163    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-963c3a\"/\"distinct-2-w3-963c3a-kserve-self-signed-certs\""
Oct 30 22:16:11.301905 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.301867    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:11.346905 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.346872    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-home\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.347083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.346921    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef98472f-83c5-490b-b4ea-57077ea8c8d4-tls-certs\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.347083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.347028    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djdgz\" (UniqueName: \"kubernetes.io/projected/ef98472f-83c5-490b-b4ea-57077ea8c8d4-kube-api-access-djdgz\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.347230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.347086    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-model-cache\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.347230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.347195    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-tmp-dir\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.347353 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.347272    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-home\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.347410 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.347366    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-dshm\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.347641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.347617    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-model-cache\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.347810 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.347702    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-tmp-dir\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.349718 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.349686    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-dshm\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.350127 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.350105    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef98472f-83c5-490b-b4ea-57077ea8c8d4-tls-certs\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.409368 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.409307    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djdgz\" (UniqueName: \"kubernetes.io/projected/ef98472f-83c5-490b-b4ea-57077ea8c8d4-kube-api-access-djdgz\") pod \"distinct-2-w3-963c3a-kserve-6657776596-n45z9\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") " pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.457254 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.457227    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:11.851153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:11.851121    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"]
Oct 30 22:16:11.851998 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:16:11.851967    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef98472f_83c5_490b_b4ea_57077ea8c8d4.slice/crio-9e2c080983f93aedbe4c1c028479d401686706b1d210d61095f235553dd32141 WatchSource:0}: Error finding container 9e2c080983f93aedbe4c1c028479d401686706b1d210d61095f235553dd32141: Status 404 returned error can't find the container with id 9e2c080983f93aedbe4c1c028479d401686706b1d210d61095f235553dd32141
Oct 30 22:16:12.074440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:12.074402    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" event={"ID":"ef98472f-83c5-490b-b4ea-57077ea8c8d4","Type":"ContainerStarted","Data":"e08b8e0434caeeea9ae1ba7369cf0dbc5ac5aaa8ea8ef35e16e1e5484a455991"}
Oct 30 22:16:12.074637 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:12.074453    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" event={"ID":"ef98472f-83c5-490b-b4ea-57077ea8c8d4","Type":"ContainerStarted","Data":"9e2c080983f93aedbe4c1c028479d401686706b1d210d61095f235553dd32141"}
Oct 30 22:16:12.193251 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:12.193151    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podStartSLOduration=1.193138728 podStartE2EDuration="1.193138728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:12.192000198 +0000 UTC m=+1286.922857340" watchObservedRunningTime="2026-10-30 22:16:12.193138728 +0000 UTC m=+1286.923995870"
Oct 30 22:16:12.457706 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:12.457626    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:13.161608 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:16:13.161560    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:16:13.496897 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:13.496776    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:18.665955 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.665917    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:18.711688 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.711658    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"]
Oct 30 22:16:18.716300 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.716281    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.823577 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.823545    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"]
Oct 30 22:16:18.842197 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.842168    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldq4p\" (UniqueName: \"kubernetes.io/projected/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-kube-api-access-ldq4p\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.842340 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.842210    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-data\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.842383 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.842353    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-podinfo\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.842419 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.842390    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-workload-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.842419 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.842410    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-token\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.842486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.842458    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-envoy\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.842564 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.842544    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-credential-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.842640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.842627    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-workload-certs\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.842704 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.842694    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istiod-ca-cert\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.943556 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.943481    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-workload-certs\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.943709 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.943558    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istiod-ca-cert\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.943709 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.943684    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldq4p\" (UniqueName: \"kubernetes.io/projected/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-kube-api-access-ldq4p\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.943781 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.943713    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-data\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.943834 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.943797    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-podinfo\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.943895 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.943830    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-workload-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.943895 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.943858    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-token\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.944015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.943924    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-workload-certs\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.944015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.943934    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-envoy\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.944015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.943991    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-credential-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.944238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.944209    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-data\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.944348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.944323    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-workload-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.944428 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.944402    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-credential-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.944466 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.944435    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istiod-ca-cert\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.946283 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.946252    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-envoy\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:18.946458 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:18.946430    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-podinfo\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:19.005424 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.005398    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-token\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:19.005741 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.005717    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldq4p\" (UniqueName: \"kubernetes.io/projected/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-kube-api-access-ldq4p\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-swntv\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:19.031233 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.031201    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:19.122988 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.122013    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"]
Oct 30 22:16:19.128631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.127861    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.186823 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.186768    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"]
Oct 30 22:16:19.248376 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.248279    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlrnz\" (UniqueName: \"kubernetes.io/projected/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-kube-api-access-hlrnz\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.248544 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.248408    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-podinfo\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.248544 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.248477    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-workload-certs\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.248719 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.248644    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istiod-ca-cert\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.248719 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.248694    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-workload-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.248833 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.248733    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-token\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.248833 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.248786    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-credential-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.248934 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.248830    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-envoy\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.248934 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.248890    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-data\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.350277 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.350246    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlrnz\" (UniqueName: \"kubernetes.io/projected/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-kube-api-access-hlrnz\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.350415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.350289    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-podinfo\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.350415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.350330    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-workload-certs\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.350415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.350379    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istiod-ca-cert\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.350415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.350409    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-workload-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.350674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.350439    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-token\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.350674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.350469    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-credential-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.350674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.350491    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-envoy\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.350674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.350522    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-data\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.350891 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.350823    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-workload-certs\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.350891 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.350875    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-workload-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.351003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.350892    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-data\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.351003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.350963    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-credential-socket\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.351415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.351394    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istiod-ca-cert\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.352927 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.352897    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-envoy\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.353019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.352987    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-podinfo\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.411958 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.411928    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-token\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.412224 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.412201    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlrnz\" (UniqueName: \"kubernetes.io/projected/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-kube-api-access-hlrnz\") pod \"e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") " pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.451736 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.451712    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:19.471870 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:16:19.471841    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2fc3f93_a312_47c1_9cfb_2cf4b4ca423c.slice/crio-3af1d5072b37d89707117a021665e06c15de366a44b953560e9558ce2f2b6638 WatchSource:0}: Error finding container 3af1d5072b37d89707117a021665e06c15de366a44b953560e9558ce2f2b6638: Status 404 returned error can't find the container with id 3af1d5072b37d89707117a021665e06c15de366a44b953560e9558ce2f2b6638
Oct 30 22:16:19.473207 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.473187    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"]
Oct 30 22:16:19.474455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.474425    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:16:19.474547 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.474505    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:16:19.474624 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.474547    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:16:19.844556 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.844525    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"]
Oct 30 22:16:19.845508 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:16:19.845481    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa28d4f_9d58_4fca_9ff3_81aa4f47befe.slice/crio-0e976855e382c59b705b01232d6ca06ce56c9ddb9c46c664a64e157e0f92195c WatchSource:0}: Error finding container 0e976855e382c59b705b01232d6ca06ce56c9ddb9c46c664a64e157e0f92195c: Status 404 returned error can't find the container with id 0e976855e382c59b705b01232d6ca06ce56c9ddb9c46c664a64e157e0f92195c
Oct 30 22:16:19.847531 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.847500    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:16:19.847633 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.847565    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:16:19.847633 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:19.847622    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:16:20.156705 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:20.150369    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2" event={"ID":"caa28d4f-9d58-4fca-9ff3-81aa4f47befe","Type":"ContainerStarted","Data":"58c413d7e6b85157f5bfbabb583dc67024b40725fa55d7611b4b8d1c52b04617"}
Oct 30 22:16:20.156705 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:20.150463    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2" event={"ID":"caa28d4f-9d58-4fca-9ff3-81aa4f47befe","Type":"ContainerStarted","Data":"0e976855e382c59b705b01232d6ca06ce56c9ddb9c46c664a64e157e0f92195c"}
Oct 30 22:16:20.168611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:20.157760    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv" event={"ID":"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c","Type":"ContainerStarted","Data":"ec8b78951ac4858fb5982a11f4a870f9c27a57319e3bdd40b5a5457b97a78039"}
Oct 30 22:16:20.168611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:20.157826    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv" event={"ID":"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c","Type":"ContainerStarted","Data":"3af1d5072b37d89707117a021665e06c15de366a44b953560e9558ce2f2b6638"}
Oct 30 22:16:20.284572 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:20.284498    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2" podStartSLOduration=1.2844783309999999 podStartE2EDuration="1.284478331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:20.274760956 +0000 UTC m=+1295.005618092" watchObservedRunningTime="2026-10-30 22:16:20.284478331 +0000 UTC m=+1295.015335476"
Oct 30 22:16:20.400780 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:20.400717    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv" podStartSLOduration=2.400698168 podStartE2EDuration="2.400698168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:20.397358907 +0000 UTC m=+1295.128216043" watchObservedRunningTime="2026-10-30 22:16:20.400698168 +0000 UTC m=+1295.131555312"
Oct 30 22:16:20.456701 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:20.455945    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:20.464622 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:20.461850    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 30 22:16:20.464622 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:20.461915    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2" podUID="caa28d4f-9d58-4fca-9ff3-81aa4f47befe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 30 22:16:21.031395 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:21.031358    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:21.032934 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:21.032900    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 22:16:21.032989 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:21.032961    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv" podUID="f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 22:16:21.464187 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:21.464155    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:21.465527 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:21.465500    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 30 22:16:21.465750 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:21.465723    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2" podUID="caa28d4f-9d58-4fca-9ff3-81aa4f47befe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 30 22:16:21.512533 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:21.512510    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:22.031909 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:22.031875    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 22:16:22.032319 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:22.031927    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv" podUID="f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 22:16:22.230196 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:22.230168    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:16:22.456613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:22.454937    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 30 22:16:22.456613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:22.454999    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2" podUID="caa28d4f-9d58-4fca-9ff3-81aa4f47befe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 30 22:16:22.737006 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:22.736924    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:23.032583 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:23.032490    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 22:16:23.032583 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:23.032552    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv" podUID="f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 22:16:23.471613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:23.462537    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 30 22:16:23.471920 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:23.471881    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2" podUID="caa28d4f-9d58-4fca-9ff3-81aa4f47befe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 30 22:16:23.824132 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:23.824101    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:24.031771 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:24.031725    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 22:16:24.031979 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:24.031788    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv" podUID="f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 22:16:24.474647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:24.474608    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 30 22:16:24.475247 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:24.475210    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2" podUID="caa28d4f-9d58-4fca-9ff3-81aa4f47befe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 30 22:16:25.031830 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:25.031793    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 22:16:25.032037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:25.031858    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv" podUID="f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 22:16:25.460927 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:25.460893    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 30 22:16:25.461178 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:25.461152    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2" podUID="caa28d4f-9d58-4fca-9ff3-81aa4f47befe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 30 22:16:26.031899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:26.031863    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 22:16:26.032348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:26.031919    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv" podUID="f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 22:16:26.452462 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:26.452423    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 30 22:16:26.452701 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:26.452489    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2" podUID="caa28d4f-9d58-4fca-9ff3-81aa4f47befe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 30 22:16:27.036199 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:27.036159    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:27.036726 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:27.036701    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:27.037511 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:27.037490    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:16:27.457706 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:27.457667    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:27.458482 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:27.458455    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:27.459235 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:27.459199    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:16:28.999803 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:28.999768    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:31.249504 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:31.249465    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:16:33.592748 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:33.592705    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:33.707860 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:33.707798    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:33.965679 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:33.964667    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 22:16:34.003751 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.003701    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:34.039614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.038669    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:34.061471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.061020    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 30 22:16:34.121511 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.120684    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:34.229790 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.229690    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:34.342191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.342144    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:34.392721 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.392672    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:34.602544 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.602500    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:34.605153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.605125    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:16:34.606966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.605354    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podUID="0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:34.713110 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.713067    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 22:16:34.713766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.713742    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:16:34.879451 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.879340    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:34.979638 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.975821    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:34.979638 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:34.977757    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:16:35.025632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.021556    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:35.025632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.021958    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:16:35.049747 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.039675    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:35.050412 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.050381    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:16:35.063617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.063554    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:35.072467 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.072445    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:16:35.120361 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.120289    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:35.127882 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.124258    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:35.131714 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.131642    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:16:35.154200 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.154165    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:16:35.164110 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.164073    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:16:35.242464 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.242437    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:16:35.425816 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.425726    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:16:35.572851 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.572816    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:16:35.583059 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.583034    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:16:35.583345 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:35.583330    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:16:39.999891 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:39.999849    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:43.162012 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:16:43.161964    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:16:45.066750 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:45.066714    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:50.332429 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:50.332386    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:55.334162 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:16:55.334126    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:00.701632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:00.698878    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:05.778551 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:05.778513    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:10.958679 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:10.958641    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:13.162168 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:17:13.162134    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:17:15.470806 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.470769    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"]
Oct 30 22:17:15.475319 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.475297    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.519597 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.519571    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"]
Oct 30 22:17:15.525410 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.525393    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.569754 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.569722    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"]
Oct 30 22:17:15.595691 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.595658    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"]
Oct 30 22:17:15.604686 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.604648    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-istio-envoy\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.604843 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.604690    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6595215-80bd-4584-8731-fce09ff3905a-istio-token\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.604912 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.604829    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-workload-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.604912 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.604865    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-workload-certs\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.605029 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.604939    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh445\" (UniqueName: \"kubernetes.io/projected/e6595215-80bd-4584-8731-fce09ff3905a-kube-api-access-dh445\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.605029 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.604997    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-credential-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.605136 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.605038    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-istio-data\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.605192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.605136    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6595215-80bd-4584-8731-fce09ff3905a-istio-podinfo\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.605192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.605168    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6595215-80bd-4584-8731-fce09ff3905a-istiod-ca-cert\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.706231 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706186    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6595215-80bd-4584-8731-fce09ff3905a-istio-podinfo\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.706231 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706239    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-workload-certs\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.706515 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706262    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6595215-80bd-4584-8731-fce09ff3905a-istiod-ca-cert\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.706515 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706279    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xnls\" (UniqueName: \"kubernetes.io/projected/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-kube-api-access-4xnls\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.706515 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706405    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-data\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.706708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706555    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-token\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.706708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706645    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-istio-envoy\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.706708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706677    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6595215-80bd-4584-8731-fce09ff3905a-istio-token\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.706874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706734    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-credential-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.706874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706763    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-envoy\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.706874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706787    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istiod-ca-cert\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.706874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706837    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-workload-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.706874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706861    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-workload-certs\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.707131 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706945    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh445\" (UniqueName: \"kubernetes.io/projected/e6595215-80bd-4584-8731-fce09ff3905a-kube-api-access-dh445\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.707131 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.706982    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-podinfo\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.707232 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.707131    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6595215-80bd-4584-8731-fce09ff3905a-istiod-ca-cert\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.707294 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.707266    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-credential-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.707357 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.707319    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-istio-data\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.707418 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.707401    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-workload-certs\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.707418 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.707411    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-workload-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.707716 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.707690    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-credential-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.707819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.707718    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-istio-data\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.707952 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.707931    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-workload-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.709079 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.709056    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6595215-80bd-4584-8731-fce09ff3905a-istio-podinfo\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.709213 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.709191    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-istio-envoy\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.768857 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.768765    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6595215-80bd-4584-8731-fce09ff3905a-istio-token\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.769493 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.769466    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh445\" (UniqueName: \"kubernetes.io/projected/e6595215-80bd-4584-8731-fce09ff3905a-kube-api-access-dh445\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.788907 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.788881    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:15.808312 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.808282    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-workload-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.808433 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.808324    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-workload-certs\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.808433 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.808352    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xnls\" (UniqueName: \"kubernetes.io/projected/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-kube-api-access-4xnls\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.808433 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.808412    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-data\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.808629 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.808488    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-token\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.808629 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.808549    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-credential-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.808629 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.808577    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-envoy\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.808629 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.808618    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istiod-ca-cert\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.808861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.808728    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-podinfo\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.808861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.808783    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-workload-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.808861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.808727    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-workload-certs\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.808861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.808826    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-data\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.809187 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.809164    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-credential-socket\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.809421 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.809399    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istiod-ca-cert\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.810758 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.810736    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-envoy\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.811554 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.811533    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-podinfo\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.873620 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.873153    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xnls\" (UniqueName: \"kubernetes.io/projected/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-kube-api-access-4xnls\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:15.873773 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:15.873650    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-token\") pod \"e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") " pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:16.098825 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:16.098790    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:16.138237 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:16.138203    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:16.232498 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:16.232463    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"]
Oct 30 22:17:16.237140 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:16.235009    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:16.237140 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:16.235088    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:16.237140 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:16.235127    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:16.546139 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:16.546108    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"]
Oct 30 22:17:16.548440 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:17:16.548409    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1b3a95_dfb1_44d6_9910_3437d0a0e313.slice/crio-ba0d8362ccb16b2b3eb26598fc7a869b999245264ed910c52c450ae792e45aec WatchSource:0}: Error finding container ba0d8362ccb16b2b3eb26598fc7a869b999245264ed910c52c450ae792e45aec: Status 404 returned error can't find the container with id ba0d8362ccb16b2b3eb26598fc7a869b999245264ed910c52c450ae792e45aec
Oct 30 22:17:16.551286 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:16.551258    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:16.551370 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:16.551323    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:16.551370 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:16.551353    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:17.077614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:17.077489    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829" event={"ID":"7d1b3a95-dfb1-44d6-9910-3437d0a0e313","Type":"ContainerStarted","Data":"944279adfc7d8b4e23c212250bff02526a010be8f9002bac6a69e62fedc4474b"}
Oct 30 22:17:17.077614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:17.077558    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829" event={"ID":"7d1b3a95-dfb1-44d6-9910-3437d0a0e313","Type":"ContainerStarted","Data":"ba0d8362ccb16b2b3eb26598fc7a869b999245264ed910c52c450ae792e45aec"}
Oct 30 22:17:17.087650 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:17.084572    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf" event={"ID":"e6595215-80bd-4584-8731-fce09ff3905a","Type":"ContainerStarted","Data":"7a2a7f8b915008c06188c9dc6a6fa6fd4aa9881dc47c317b08ed7709abe57bb1"}
Oct 30 22:17:17.087650 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:17.084649    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf" event={"ID":"e6595215-80bd-4584-8731-fce09ff3905a","Type":"ContainerStarted","Data":"71c1f23436afb7ab207e45d4f02a1e24c3b2e3ba33afc131c28e6e7cd9bb58fd"}
Oct 30 22:17:17.138532 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:17.138496    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:17.143372 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:17.140544    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 22:17:17.143372 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:17.140615    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829" podUID="7d1b3a95-dfb1-44d6-9910-3437d0a0e313" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 22:17:17.396680 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:17.366431    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829" podStartSLOduration=2.366410863 podStartE2EDuration="2.366410863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:17.220882587 +0000 UTC m=+1351.951739742" watchObservedRunningTime="2026-10-30 22:17:17.366410863 +0000 UTC m=+1352.097268009"
Oct 30 22:17:17.795677 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:17.792633    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:17.795677 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:17.792789    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 22:17:17.795677 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:17.792834    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf" podUID="e6595215-80bd-4584-8731-fce09ff3905a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 22:17:18.140613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.138972    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 22:17:18.140613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.139030    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829" podUID="7d1b3a95-dfb1-44d6-9910-3437d0a0e313" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 22:17:18.624289 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.623842    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:18.629140 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.629068    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf" podStartSLOduration=3.629051229 podStartE2EDuration="3.629051229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:17.413608683 +0000 UTC m=+1352.144465809" watchObservedRunningTime="2026-10-30 22:17:18.629051229 +0000 UTC m=+1353.359908377"
Oct 30 22:17:18.632964 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.632942    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"]
Oct 30 22:17:18.637536 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.637517    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.737186 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.737146    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"]
Oct 30 22:17:18.836150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.834913    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-credential-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.836150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.835008    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89c01284-2e3c-4637-93ad-b3d27024a745-istio-token\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.836150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.835091    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-664ln\" (UniqueName: \"kubernetes.io/projected/89c01284-2e3c-4637-93ad-b3d27024a745-kube-api-access-664ln\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.836150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.835132    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-workload-certs\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.836150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.835157    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-workload-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.836150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.835190    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89c01284-2e3c-4637-93ad-b3d27024a745-istiod-ca-cert\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.836150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.835306    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-istio-envoy\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.836150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.835368    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89c01284-2e3c-4637-93ad-b3d27024a745-istio-podinfo\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.836150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.835405    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-istio-data\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.836150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.835776    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 22:17:18.836150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.835823    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf" podUID="e6595215-80bd-4584-8731-fce09ff3905a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 22:17:18.919896 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.919810    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:18.937662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.937288    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-istio-envoy\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.937662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.937351    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89c01284-2e3c-4637-93ad-b3d27024a745-istio-podinfo\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.937662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.937370    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-istio-data\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.937662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.937432    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-credential-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.937662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.937479    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89c01284-2e3c-4637-93ad-b3d27024a745-istio-token\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.937662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.937534    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-664ln\" (UniqueName: \"kubernetes.io/projected/89c01284-2e3c-4637-93ad-b3d27024a745-kube-api-access-664ln\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.937662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.937560    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-workload-certs\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.938102 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.937905    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-istio-data\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.938102 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.937957    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-workload-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.938102 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.938011    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-workload-certs\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.938404 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.938311    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89c01284-2e3c-4637-93ad-b3d27024a745-istiod-ca-cert\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.938404 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.938360    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-workload-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.938404 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.938314    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-credential-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.939022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.938993    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89c01284-2e3c-4637-93ad-b3d27024a745-istiod-ca-cert\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.939780 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.939758    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-istio-envoy\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:18.940686 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:18.940659    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89c01284-2e3c-4637-93ad-b3d27024a745-istio-podinfo\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:19.009562 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:19.009527    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-664ln\" (UniqueName: \"kubernetes.io/projected/89c01284-2e3c-4637-93ad-b3d27024a745-kube-api-access-664ln\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:19.010554 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:19.010528    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89c01284-2e3c-4637-93ad-b3d27024a745-istio-token\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:19.139453 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:19.139419    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 22:17:19.139646 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:19.139467    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829" podUID="7d1b3a95-dfb1-44d6-9910-3437d0a0e313" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 22:17:19.292903 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:19.292815    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:19.799406 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:19.798774    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 22:17:19.799406 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:19.798847    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf" podUID="e6595215-80bd-4584-8731-fce09ff3905a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 22:17:19.806017 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:17:19.805985    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c01284_2e3c_4637_93ad_b3d27024a745.slice/crio-ad6df1e9de52cf3620d721acac9d39dcd4fb0c65961ad4bc5294979d618bd061 WatchSource:0}: Error finding container ad6df1e9de52cf3620d721acac9d39dcd4fb0c65961ad4bc5294979d618bd061: Status 404 returned error can't find the container with id ad6df1e9de52cf3620d721acac9d39dcd4fb0c65961ad4bc5294979d618bd061
Oct 30 22:17:19.808312 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:19.808280    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"]
Oct 30 22:17:19.809115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:19.809087    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:19.809176 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:19.809146    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:19.809208 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:19.809175    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:20.133652 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:20.132016    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4" event={"ID":"89c01284-2e3c-4637-93ad-b3d27024a745","Type":"ContainerStarted","Data":"82278aa32afda5eefb72ae90384eac1df8f3743163492636875c7a5e99b311cc"}
Oct 30 22:17:20.133652 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:20.132069    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4" event={"ID":"89c01284-2e3c-4637-93ad-b3d27024a745","Type":"ContainerStarted","Data":"ad6df1e9de52cf3620d721acac9d39dcd4fb0c65961ad4bc5294979d618bd061"}
Oct 30 22:17:20.139392 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:20.139362    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 22:17:20.139634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:20.139432    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829" podUID="7d1b3a95-dfb1-44d6-9910-3437d0a0e313" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 22:17:20.324186 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:20.324101    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:20.326003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:20.325943    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 22:17:20.326003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:20.325994    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4" podUID="89c01284-2e3c-4637-93ad-b3d27024a745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 22:17:20.330122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:20.330071    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4" podStartSLOduration=2.330044344 podStartE2EDuration="2.330044344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:20.324422487 +0000 UTC m=+1355.055279631" watchObservedRunningTime="2026-10-30 22:17:20.330044344 +0000 UTC m=+1355.060901486"
Oct 30 22:17:20.804613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:20.804024    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 22:17:20.804613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:20.804088    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf" podUID="e6595215-80bd-4584-8731-fce09ff3905a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 22:17:21.139656 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:21.139209    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 22:17:21.139656 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:21.139264    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829" podUID="7d1b3a95-dfb1-44d6-9910-3437d0a0e313" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 22:17:21.298615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:21.295375    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 22:17:21.298615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:21.295437    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4" podUID="89c01284-2e3c-4637-93ad-b3d27024a745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 22:17:21.599691 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:21.591672    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:21.796190 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:21.789936    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 22:17:21.796190 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:21.789998    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf" podUID="e6595215-80bd-4584-8731-fce09ff3905a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 22:17:22.147611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:22.147202    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 22:17:22.147611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:22.147263    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829" podUID="7d1b3a95-dfb1-44d6-9910-3437d0a0e313" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 22:17:22.300738 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:22.300704    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 22:17:22.301009 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:22.300981    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4" podUID="89c01284-2e3c-4637-93ad-b3d27024a745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 22:17:22.790620 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:22.790355    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 22:17:22.790620 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:22.790411    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf" podUID="e6595215-80bd-4584-8731-fce09ff3905a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 22:17:23.140235 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:23.140194    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 22:17:23.140450 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:23.140256    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829" podUID="7d1b3a95-dfb1-44d6-9910-3437d0a0e313" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 22:17:23.190613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:23.189893    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:23.299922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:23.299883    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 22:17:23.300216 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:23.300185    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4" podUID="89c01284-2e3c-4637-93ad-b3d27024a745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 22:17:24.348614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:24.346544    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 22:17:24.348614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:24.346624    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4" podUID="89c01284-2e3c-4637-93ad-b3d27024a745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 22:17:24.408609 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:24.405729    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:24.408609 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:24.407110    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:24.408867 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:24.408629    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:17:24.630342 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:24.630258    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:24.630931 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:24.630909    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:24.632614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:24.632026    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:17:25.294435 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.294394    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 22:17:25.294642 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.294451    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4" podUID="89c01284-2e3c-4637-93ad-b3d27024a745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 22:17:25.607014 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.606983    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"]
Oct 30 22:17:25.611428 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.611408    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"
Oct 30 22:17:25.680752 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.680719    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:17:25.681104 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.681084    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l4mjj\""
Oct 30 22:17:25.697297 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.697268    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"]
Oct 30 22:17:25.698216 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.698184    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef4c4ad1-cd14-45fc-a321-56b6794e69af-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3b04a455-4jqjv\" (UID: \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"
Oct 30 22:17:25.698372 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.698351    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef4c4ad1-cd14-45fc-a321-56b6794e69af-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3b04a455-4jqjv\" (UID: \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"
Oct 30 22:17:25.698455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.698438    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnr68\" (UniqueName: \"kubernetes.io/projected/ef4c4ad1-cd14-45fc-a321-56b6794e69af-kube-api-access-vnr68\") pod \"maas-api-revoke-sub-3b04a455-4jqjv\" (UID: \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"
Oct 30 22:17:25.800321 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.800224    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef4c4ad1-cd14-45fc-a321-56b6794e69af-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3b04a455-4jqjv\" (UID: \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"
Oct 30 22:17:25.800512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.800337    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnr68\" (UniqueName: \"kubernetes.io/projected/ef4c4ad1-cd14-45fc-a321-56b6794e69af-kube-api-access-vnr68\") pod \"maas-api-revoke-sub-3b04a455-4jqjv\" (UID: \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"
Oct 30 22:17:25.800607 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.800513    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef4c4ad1-cd14-45fc-a321-56b6794e69af-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3b04a455-4jqjv\" (UID: \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"
Oct 30 22:17:25.801208 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.801183    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef4c4ad1-cd14-45fc-a321-56b6794e69af-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3b04a455-4jqjv\" (UID: \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"
Oct 30 22:17:25.802831 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.802806    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef4c4ad1-cd14-45fc-a321-56b6794e69af-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3b04a455-4jqjv\" (UID: \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"
Oct 30 22:17:25.886458 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.886364    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnr68\" (UniqueName: \"kubernetes.io/projected/ef4c4ad1-cd14-45fc-a321-56b6794e69af-kube-api-access-vnr68\") pod \"maas-api-revoke-sub-3b04a455-4jqjv\" (UID: \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"
Oct 30 22:17:25.925959 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:25.925929    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"
Oct 30 22:17:26.295507 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:26.295411    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 22:17:26.295507 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:26.295477    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4" podUID="89c01284-2e3c-4637-93ad-b3d27024a745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 22:17:26.361626 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:26.361580    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"]
Oct 30 22:17:26.365167 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:17:26.365136    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef4c4ad1_cd14_45fc_a321_56b6794e69af.slice/crio-76776200b301171d425ca6345c5961d661e29998dbed3b3770cf1d49b60e88fc WatchSource:0}: Error finding container 76776200b301171d425ca6345c5961d661e29998dbed3b3770cf1d49b60e88fc: Status 404 returned error can't find the container with id 76776200b301171d425ca6345c5961d661e29998dbed3b3770cf1d49b60e88fc
Oct 30 22:17:26.809787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:26.809505    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:27.405535 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:27.405500    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv" event={"ID":"ef4c4ad1-cd14-45fc-a321-56b6794e69af","Type":"ContainerStarted","Data":"e86f19c512298b30faababc7b8fc9b1113f29908b94098404440f3098b60ad4b"}
Oct 30 22:17:27.406174 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:27.405554    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv" event={"ID":"ef4c4ad1-cd14-45fc-a321-56b6794e69af","Type":"ContainerStarted","Data":"76776200b301171d425ca6345c5961d661e29998dbed3b3770cf1d49b60e88fc"}
Oct 30 22:17:27.528467 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:27.528406    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv" podStartSLOduration=2.52838811 podStartE2EDuration="2.52838811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:27.523125513 +0000 UTC m=+1362.253982657" watchObservedRunningTime="2026-10-30 22:17:27.52838811 +0000 UTC m=+1362.259245254"
Oct 30 22:17:27.668668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:27.666710    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:27.668668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:27.668190    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:27.669636 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:27.669433    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:17:28.411782 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:28.411748    5258 generic.go:356] "Generic (PLEG): container finished" podID="ef4c4ad1-cd14-45fc-a321-56b6794e69af" containerID="e86f19c512298b30faababc7b8fc9b1113f29908b94098404440f3098b60ad4b" exitCode=0
Oct 30 22:17:28.412238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:28.411829    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv" event={"ID":"ef4c4ad1-cd14-45fc-a321-56b6794e69af","Type":"ContainerDied","Data":"e86f19c512298b30faababc7b8fc9b1113f29908b94098404440f3098b60ad4b"}
Oct 30 22:17:29.619893 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:29.619863    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"
Oct 30 22:17:29.764753 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:29.764665    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef4c4ad1-cd14-45fc-a321-56b6794e69af-kube-api-access-vnr68\" (UniqueName: \"kubernetes.io/projected/ef4c4ad1-cd14-45fc-a321-56b6794e69af-kube-api-access-vnr68\") pod \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\" (UID: \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\") "
Oct 30 22:17:29.764753 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:29.764722    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef4c4ad1-cd14-45fc-a321-56b6794e69af-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef4c4ad1-cd14-45fc-a321-56b6794e69af-maas-api-xks-ca\") pod \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\" (UID: \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\") "
Oct 30 22:17:29.764979 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:29.764890    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ef4c4ad1-cd14-45fc-a321-56b6794e69af-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef4c4ad1-cd14-45fc-a321-56b6794e69af-maas-api-openshift-ca\") pod \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\" (UID: \"ef4c4ad1-cd14-45fc-a321-56b6794e69af\") "
Oct 30 22:17:29.765414 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:29.765387    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef4c4ad1-cd14-45fc-a321-56b6794e69af-maas-api-openshift-ca" pod "ef4c4ad1-cd14-45fc-a321-56b6794e69af" (UID: "ef4c4ad1-cd14-45fc-a321-56b6794e69af"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:17:29.765692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:29.765673    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef4c4ad1-cd14-45fc-a321-56b6794e69af-maas-api-openshift-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:29.767448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:29.767413    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef4c4ad1-cd14-45fc-a321-56b6794e69af-kube-api-access-vnr68" pod "ef4c4ad1-cd14-45fc-a321-56b6794e69af" (UID: "ef4c4ad1-cd14-45fc-a321-56b6794e69af"). InnerVolumeSpecName "kube-api-access-vnr68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:29.767448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:29.767424    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef4c4ad1-cd14-45fc-a321-56b6794e69af-maas-api-xks-ca" pod "ef4c4ad1-cd14-45fc-a321-56b6794e69af" (UID: "ef4c4ad1-cd14-45fc-a321-56b6794e69af"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:17:29.867455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:29.867425    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnr68\" (UniqueName: \"kubernetes.io/projected/ef4c4ad1-cd14-45fc-a321-56b6794e69af-kube-api-access-vnr68\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:29.867455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:29.867454    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef4c4ad1-cd14-45fc-a321-56b6794e69af-maas-api-xks-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:30.193420 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:30.193386    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:17:30.271450 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:30.271417    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:30.429888 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:30.429847    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv" event={"ID":"ef4c4ad1-cd14-45fc-a321-56b6794e69af","Type":"ContainerDied","Data":"76776200b301171d425ca6345c5961d661e29998dbed3b3770cf1d49b60e88fc"}
Oct 30 22:17:30.430097 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:30.429914    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76776200b301171d425ca6345c5961d661e29998dbed3b3770cf1d49b60e88fc"
Oct 30 22:17:30.430097 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:30.429994    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"
Oct 30 22:17:30.516647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:30.516507    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:32.569620 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:32.568466    5258 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:32.577619 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:32.576430    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:32.593641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:32.586664    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 30 22:17:32.745622 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:32.745132    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:33.134950 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:33.134906    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 30 22:17:33.178919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:33.177069    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:33.244010 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:33.243959    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 22:17:33.245339 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:33.243992    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": context deadline exceeded"
Oct 30 22:17:33.306823 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:33.306695    5258 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": context deadline exceeded"
Oct 30 22:17:33.348286 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:33.348238    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:33.379580 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:33.379538    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:33.425791 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:33.425685    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:33.580606 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:33.580546    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 22:17:33.581467 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:33.581435    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 22:17:33.581957 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:33.581938    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:17:33.594215 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:33.588051    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:33.594215 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:33.588345    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:17:33.630426 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:33.630371    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podUID="0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:34.156929 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.156875    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:34.159065 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.159031    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:17:34.311615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.224158    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": context deadline exceeded"
Oct 30 22:17:34.311615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.260329    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:17:34.390036 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.347191    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 22:17:34.390036 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.367637    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:17:34.455937 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.455684    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:34.524814 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.524778    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:17:34.555616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.456122    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:34.584170 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.459678    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": context deadline exceeded"
Oct 30 22:17:34.647615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.583670    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:34.795971 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.583688    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:34.796376 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.618607    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:17:34.796904 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.618975    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:34.797098 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.640649    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podUID="0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": context deadline exceeded"
Oct 30 22:17:34.797466 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.797448    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:17:34.933641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.932524    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:17:34.938488 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.938459    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"]
Oct 30 22:17:34.939717 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.939693    5258 cpu_manager.go:414] "containerMap: removing container" podUID="ef4c4ad1-cd14-45fc-a321-56b6794e69af" containerName="revoke-keys"
Oct 30 22:17:34.941666 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.941647    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef4c4ad1-cd14-45fc-a321-56b6794e69af" containerName="revoke-keys"
Oct 30 22:17:34.942072 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:34.942042    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef4c4ad1-cd14-45fc-a321-56b6794e69af" containerName="revoke-keys"
Oct 30 22:17:35.022825 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.022788    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"]
Oct 30 22:17:35.023113 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.023096    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:17:35.023285 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.023273    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:17:35.023385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.022995    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.173517 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.159449    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:35.226474 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.225869    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:35.261781 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.261745    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-token\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.285442 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.285316    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-workload-certs\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.290930 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.290894    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-envoy\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.296828 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.296805    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-workload-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.300798 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.300761    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-podinfo\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.355514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.351394    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": context deadline exceeded"
Oct 30 22:17:35.355514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.352051    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:35.376670 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.363885    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istiod-ca-cert\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.376670 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.371794    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-data\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.566615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.541700    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 22:17:35.581738 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.581700    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-credential-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.582332 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.582307    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smfpf\" (UniqueName: \"kubernetes.io/projected/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-kube-api-access-smfpf\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.629792 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.629690    5258 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:35.687441 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.640826    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 22:17:35.710807 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.692921    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-workload-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.711135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.711108    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-podinfo\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.711388 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.711367    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istiod-ca-cert\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.711535 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.711513    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-data\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.711850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.711828    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-credential-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.711995 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.711977    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smfpf\" (UniqueName: \"kubernetes.io/projected/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-kube-api-access-smfpf\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.712183 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.712166    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-token\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.712458 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.712438    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-workload-certs\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.712619 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.712602    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-envoy\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.713492 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.713466    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-credential-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.717670 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.708343    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-workload-socket\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.726610 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.718900    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istiod-ca-cert\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.752732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.752695    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-data\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.763343 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.761930    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-workload-certs\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.810613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.804855    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:35.810613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.807617    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:35.810613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.807917    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:35.810939 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.810756    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:17:35.811291 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.811256    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podUID="0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:35.948665 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.924189    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-token\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:35.949694 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:35.933166    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smfpf\" (UniqueName: \"kubernetes.io/projected/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-kube-api-access-smfpf\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:36.044665 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.044157    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:17:36.058725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.056287    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-podinfo\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:36.063754 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.063730    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:17:36.139210 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.138920    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:17:36.190887 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.190849    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-envoy\") pod \"e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") " pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:36.207388 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.204018    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:36.209785 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.209241    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:17:36.295811 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.295777    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:36.382658 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.357316    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:17:36.447678 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.447624    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:17:36.482563 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.479568    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:17:36.497270 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.490928    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:17:36.901736 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.901694    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:36.905606 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.902340    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:36.905606 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.902453    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:36.911756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.908218    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:36.930178 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:36.930146    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"]
Oct 30 22:17:37.162087 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:37.161890    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:37.493682 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:37.493436    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8" event={"ID":"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa","Type":"ContainerStarted","Data":"a8dfecb0a8328dece314d98ef443333d3fc14995ae9d697f5a42143ae315639c"}
Oct 30 22:17:37.493682 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:37.493522    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8" event={"ID":"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa","Type":"ContainerStarted","Data":"7e492ffacd8db07de545e8dadcb747e6777fdcd8ff3ebdcb174355e39ac6948c"}
Oct 30 22:17:37.807548 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:37.807493    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8" podStartSLOduration=4.807476877 podStartE2EDuration="4.807476877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:37.78248004 +0000 UTC m=+1372.513337184" watchObservedRunningTime="2026-10-30 22:17:37.807476877 +0000 UTC m=+1372.538334074"
Oct 30 22:17:38.089800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:38.089714    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"]
Oct 30 22:17:38.093626 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:38.093552    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fbcd5b19-trhm7"]
Oct 30 22:17:38.296760 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:38.296715    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:38.298044 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:38.298011    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:17:38.298222 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:38.298080    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8" podUID="3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:17:39.297176 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:39.297141    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:17:39.297676 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:39.297198    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8" podUID="3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:17:39.398610 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:39.395642    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:39.429816 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:39.429782    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="96f006f7-7303-448b-a840-e1cf95ee3b99" path="/var/lib/kubelet/pods/96f006f7-7303-448b-a840-e1cf95ee3b99/volumes"
Oct 30 22:17:40.297648 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:40.297616    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:17:40.298038 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:40.297670    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8" podUID="3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:17:41.297388 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:41.297351    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:17:41.297610 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:41.297406    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8" podUID="3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:17:42.296744 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:42.296704    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:17:42.297261 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:42.296774    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8" podUID="3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:17:43.169486 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:17:43.169420    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:17:43.296925 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:43.296890    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:17:43.297421 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:43.296969    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8" podUID="3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:17:44.492254 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:44.492167    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:44.499511 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:44.499486    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:44.501040 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:44.501014    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:44.501941 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:44.501920    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:17:49.519132 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.519097    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:49.524428 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.524393    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"]
Oct 30 22:17:49.533225 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.533197    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.621981 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.621946    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"]
Oct 30 22:17:49.684418 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.684376    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-envoy\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.684628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.684503    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-podinfo\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.684628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.684552    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-workload-certs\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.684628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.684584    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-credential-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.684820 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.684628    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-token\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.684820 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.684663    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istiod-ca-cert\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.684820 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.684716    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmggn\" (UniqueName: \"kubernetes.io/projected/483ce3ac-7be5-43be-ab91-6b26d13f9f80-kube-api-access-bmggn\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.684820 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.684751    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-data\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.684820 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.684793    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-workload-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.786397 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.786310    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-envoy\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.786397 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.786365    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-podinfo\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.786397 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.786394    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-workload-certs\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.786698 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.786421    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-credential-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.786698 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.786455    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-token\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.786698 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.786484    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istiod-ca-cert\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.786698 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.786516    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmggn\" (UniqueName: \"kubernetes.io/projected/483ce3ac-7be5-43be-ab91-6b26d13f9f80-kube-api-access-bmggn\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.786946 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.786919    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-credential-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.787009 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.786941    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-workload-certs\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.787009 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.786991    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-data\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.787147 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.787124    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-workload-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.787312 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.787289    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istiod-ca-cert\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.787408 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.787388    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-data\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.787543 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.787518    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-workload-socket\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.788777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.788758    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-envoy\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.789005 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.788987    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-podinfo\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.848325 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.848295    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-token\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.848624 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.848580    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmggn\" (UniqueName: \"kubernetes.io/projected/483ce3ac-7be5-43be-ab91-6b26d13f9f80-kube-api-access-bmggn\") pod \"e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") " pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:49.861618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:49.861584    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:50.300722 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.300694    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"]
Oct 30 22:17:50.301427 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:17:50.301404    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod483ce3ac_7be5_43be_ab91_6b26d13f9f80.slice/crio-7c5e8f17a105a7c573cbba1194d420bf9cec71998ef7cc2bdddf8fcb5dc0229c WatchSource:0}: Error finding container 7c5e8f17a105a7c573cbba1194d420bf9cec71998ef7cc2bdddf8fcb5dc0229c: Status 404 returned error can't find the container with id 7c5e8f17a105a7c573cbba1194d420bf9cec71998ef7cc2bdddf8fcb5dc0229c
Oct 30 22:17:50.303989 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.303956    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:50.304074 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.304020    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:50.304074 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.304050    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:50.588811 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.588772    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"]
Oct 30 22:17:50.594198 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.594173    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.610057 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.610028    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"]
Oct 30 22:17:50.614283 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.614259    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr" event={"ID":"483ce3ac-7be5-43be-ab91-6b26d13f9f80","Type":"ContainerStarted","Data":"d1d0187c77eb4fa2953cf9f522cc2db0f76c89da21138e34d2e8b593fe3d41c6"}
Oct 30 22:17:50.614283 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.614288    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr" event={"ID":"483ce3ac-7be5-43be-ab91-6b26d13f9f80","Type":"ContainerStarted","Data":"7c5e8f17a105a7c573cbba1194d420bf9cec71998ef7cc2bdddf8fcb5dc0229c"}
Oct 30 22:17:50.614445 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.614383    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.655716 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.655675    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"]
Oct 30 22:17:50.683001 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.680379    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"]
Oct 30 22:17:50.702559 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.702520    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df963eee-a95d-438b-be00-94119985e1aa-istio-podinfo\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.702724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.702621    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-token\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.702724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.702690    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df963eee-a95d-438b-be00-94119985e1aa-istio-token\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.702861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.702811    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b956fb-6a5f-4e18-800b-a94cb43dba93-istiod-ca-cert\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.702952 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.702932    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x6cj\" (UniqueName: \"kubernetes.io/projected/19b956fb-6a5f-4e18-800b-a94cb43dba93-kube-api-access-6x6cj\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.703012 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.702980    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df963eee-a95d-438b-be00-94119985e1aa-istiod-ca-cert\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.703173 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.703145    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-workload-certs\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.703249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.703192    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-credential-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.703249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.703219    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-istio-data\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.703249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.703243    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-workload-certs\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.703416 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.703308    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-workload-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.703478 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.703462    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-credential-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.703523 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.703496    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-data\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.703688 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.703662    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-podinfo\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.703781 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.703758    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-envoy\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.703841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.703796    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j6xb\" (UniqueName: \"kubernetes.io/projected/df963eee-a95d-438b-be00-94119985e1aa-kube-api-access-8j6xb\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.703973 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.703953    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-workload-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.704063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.704045    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-istio-envoy\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.805275 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805242    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df963eee-a95d-438b-be00-94119985e1aa-istio-podinfo\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.805486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805388    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-token\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.805486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805450    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df963eee-a95d-438b-be00-94119985e1aa-istio-token\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.805636 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805501    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b956fb-6a5f-4e18-800b-a94cb43dba93-istiod-ca-cert\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.805636 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805526    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x6cj\" (UniqueName: \"kubernetes.io/projected/19b956fb-6a5f-4e18-800b-a94cb43dba93-kube-api-access-6x6cj\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.805636 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805550    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df963eee-a95d-438b-be00-94119985e1aa-istiod-ca-cert\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.805636 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805613    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-workload-certs\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.805878 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805645    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-credential-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.805878 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805670    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-istio-data\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.805878 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805694    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-workload-certs\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.805878 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805745    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-workload-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.805878 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805815    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-credential-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.805878 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805845    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-data\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.806238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805931    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-podinfo\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.806238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.805977    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-envoy\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.806238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.806003    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j6xb\" (UniqueName: \"kubernetes.io/projected/df963eee-a95d-438b-be00-94119985e1aa-kube-api-access-8j6xb\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.806238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.806120    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-workload-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.806445 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.806198    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-istio-envoy\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.806498 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.806451    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b956fb-6a5f-4e18-800b-a94cb43dba93-istiod-ca-cert\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.809490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.806795    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-workload-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.809490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.806939    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-workload-certs\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.809490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.806974    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-credential-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.809490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.807068    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-workload-certs\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.809490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.807206    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-istio-data\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.809490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.808274    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df963eee-a95d-438b-be00-94119985e1aa-istiod-ca-cert\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.809490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.808723    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-workload-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.809490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.808996    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-data\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.810171 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.810152    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-envoy\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.810247 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.810213    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-credential-socket\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.810350 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.810332    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-istio-envoy\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.811876 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.811853    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df963eee-a95d-438b-be00-94119985e1aa-istio-podinfo\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.812138 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.812122    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-podinfo\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.846480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.846039    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr" podStartSLOduration=1.846018768 podStartE2EDuration="1.846018768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:50.844977487 +0000 UTC m=+1385.575834630" watchObservedRunningTime="2026-10-30 22:17:50.846018768 +0000 UTC m=+1385.576875912"
Oct 30 22:17:50.863768 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.863675    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:50.887198 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.887152    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df963eee-a95d-438b-be00-94119985e1aa-istio-token\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.888021 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.887989    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x6cj\" (UniqueName: \"kubernetes.io/projected/19b956fb-6a5f-4e18-800b-a94cb43dba93-kube-api-access-6x6cj\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.888147 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.888059    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-token\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.888147 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.888130    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j6xb\" (UniqueName: \"kubernetes.io/projected/df963eee-a95d-438b-be00-94119985e1aa-kube-api-access-8j6xb\") pod \"e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") " pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:50.910188 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.910161    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:50.927690 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:50.927662    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:51.395551 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:17:51.395469    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b956fb_6a5f_4e18_800b_a94cb43dba93.slice/crio-276abb073fabbcf79ab73480cfda4e393d3077fe12e31411771aa0da7f3cdf7b WatchSource:0}: Error finding container 276abb073fabbcf79ab73480cfda4e393d3077fe12e31411771aa0da7f3cdf7b: Status 404 returned error can't find the container with id 276abb073fabbcf79ab73480cfda4e393d3077fe12e31411771aa0da7f3cdf7b
Oct 30 22:17:51.408555 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.408528    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"]
Oct 30 22:17:51.408686 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.408615    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"]
Oct 30 22:17:51.409415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.409382    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:51.409520 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.409449    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:51.409520 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.409484    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:51.411351 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.411322    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:51.411421 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.411382    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:51.411421 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.411408    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:17:51.424435 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.424408    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:51.625817 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.625664    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" event={"ID":"df963eee-a95d-438b-be00-94119985e1aa","Type":"ContainerStarted","Data":"1375ea864f7ef25b3cd331bf8e11caf0c6de20ccd33d1a4b4c56d953c050dd47"}
Oct 30 22:17:51.625817 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.625776    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" event={"ID":"df963eee-a95d-438b-be00-94119985e1aa","Type":"ContainerStarted","Data":"eed5b9ed59c9e4898ad835d23bca68f7c635bdc8b3b4afb5fee67170c2744d1d"}
Oct 30 22:17:51.629762 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.629727    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt" event={"ID":"19b956fb-6a5f-4e18-800b-a94cb43dba93","Type":"ContainerStarted","Data":"559816cab64014f586615c483d40fc4f5d159f881ad7498533f17ce35bd2c604"}
Oct 30 22:17:51.629960 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.629942    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt" event={"ID":"19b956fb-6a5f-4e18-800b-a94cb43dba93","Type":"ContainerStarted","Data":"276abb073fabbcf79ab73480cfda4e393d3077fe12e31411771aa0da7f3cdf7b"}
Oct 30 22:17:51.780932 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.780814    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" podStartSLOduration=1.780792574 podStartE2EDuration="1.780792574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:51.755032992 +0000 UTC m=+1386.485890138" watchObservedRunningTime="2026-10-30 22:17:51.780792574 +0000 UTC m=+1386.511649722"
Oct 30 22:17:51.809231 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.809194    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:51.867615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.863752    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 22:17:51.867615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.863817    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr" podUID="483ce3ac-7be5-43be-ab91-6b26d13f9f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 22:17:51.911031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.910766    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:17:51.927913 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:51.927882    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:52.149309 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:52.127584    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:52.829643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:52.724048    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:52.890739 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:52.890698    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 22:17:52.891017 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:52.890990    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr" podUID="483ce3ac-7be5-43be-ab91-6b26d13f9f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 22:17:52.919893 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:52.919856    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 22:17:52.920161 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:52.920130    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt" podUID="19b956fb-6a5f-4e18-800b-a94cb43dba93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 22:17:52.930990 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:52.930957    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 22:17:52.934621 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:52.931198    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" podUID="df963eee-a95d-438b-be00-94119985e1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 22:17:53.079977 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:53.079883    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:53.504750 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:53.481970    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:53.870523 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:53.864967    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 22:17:53.870523 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:53.865032    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr" podUID="483ce3ac-7be5-43be-ab91-6b26d13f9f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 22:17:53.919617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:53.916850    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 22:17:53.919617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:53.916914    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt" podUID="19b956fb-6a5f-4e18-800b-a94cb43dba93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 22:17:53.939948 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:53.928188    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 22:17:53.939948 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:53.928259    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" podUID="df963eee-a95d-438b-be00-94119985e1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 22:17:54.862933 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:54.862899    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 22:17:54.867747 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:54.863114    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr" podUID="483ce3ac-7be5-43be-ab91-6b26d13f9f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 22:17:54.916627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:54.916052    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 22:17:54.916627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:54.916116    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt" podUID="19b956fb-6a5f-4e18-800b-a94cb43dba93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 22:17:54.928868 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:54.928705    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 22:17:54.928868 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:54.928763    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" podUID="df963eee-a95d-438b-be00-94119985e1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 22:17:55.539615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:55.538620    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:55.900643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:55.891045    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 22:17:55.900643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:55.891113    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr" podUID="483ce3ac-7be5-43be-ab91-6b26d13f9f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 22:17:55.941617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:55.939917    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 22:17:55.941617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:55.939990    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" podUID="df963eee-a95d-438b-be00-94119985e1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 22:17:55.941617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:55.940541    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 22:17:55.941617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:55.940635    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt" podUID="19b956fb-6a5f-4e18-800b-a94cb43dba93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 22:17:56.872615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:56.864573    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 22:17:56.872615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:56.864653    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr" podUID="483ce3ac-7be5-43be-ab91-6b26d13f9f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 22:17:56.912628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:56.911075    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 22:17:56.912628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:56.911151    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt" podUID="19b956fb-6a5f-4e18-800b-a94cb43dba93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 22:17:56.927974 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:56.927923    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 22:17:56.928160 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:56.927983    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" podUID="df963eee-a95d-438b-be00-94119985e1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 22:17:57.236741 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:57.236185    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:57.496668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:57.496139    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:57.917614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:57.914864    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 22:17:57.917614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:57.914962    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt" podUID="19b956fb-6a5f-4e18-800b-a94cb43dba93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 22:17:57.928833 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:57.928794    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 22:17:57.928990 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:57.928854    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" podUID="df963eee-a95d-438b-be00-94119985e1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 22:17:58.497373 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:58.497340    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:58.512761 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:58.512732    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:58.516357 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:58.516234    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:17:58.685283 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:58.685218    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt" podStartSLOduration=8.68519989 podStartE2EDuration="8.68519989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:51.884039275 +0000 UTC m=+1386.614896420" watchObservedRunningTime="2026-10-30 22:17:58.68519989 +0000 UTC m=+1393.416057051"
Oct 30 22:17:58.910924 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:58.910884    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Oct 30 22:17:58.911129 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:58.910942    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt" podUID="19b956fb-6a5f-4e18-800b-a94cb43dba93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Oct 30 22:17:58.929881 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:58.929088    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 22:17:58.929881 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:58.929148    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" podUID="df963eee-a95d-438b-be00-94119985e1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 22:17:59.954497 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:59.951644    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:59.954497 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:59.953233    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:17:59.954497 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:17:59.954268    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:18:00.142142 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:00.142111    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:18:00.143933 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:00.143904    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:18:00.145732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:00.145701    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:18:00.402612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:00.400170    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:01.098664 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:01.098629    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:01.357625 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:01.357493    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:01.612689 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:01.612577    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:01.872506 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:01.872402    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:02.131551 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:02.131456    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:02.889940 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:02.889903    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:03.124843 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:03.124427    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:04.167460 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:04.167419    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:04.405853 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:04.405817    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:05.138684 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.138644    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:05.382123 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.382089    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:05.399675 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.399583    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"]
Oct 30 22:18:05.406162 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.406138    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.447107 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.447083    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-workload-certs\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.447225 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.447140    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkkc2\" (UniqueName: \"kubernetes.io/projected/56977125-2b70-474b-b9a6-f0573841b207-kube-api-access-fkkc2\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.447225 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.447211    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56977125-2b70-474b-b9a6-f0573841b207-istiod-ca-cert\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.447313 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.447271    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-workload-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.447313 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.447299    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56977125-2b70-474b-b9a6-f0573841b207-istio-podinfo\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.447390 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.447331    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-istio-data\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.447434 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.447412    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-credential-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.447486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.447473    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56977125-2b70-474b-b9a6-f0573841b207-istio-token\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.447548 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.447535    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-istio-envoy\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.464859 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.464832    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"]
Oct 30 22:18:05.548809 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.548774    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56977125-2b70-474b-b9a6-f0573841b207-istio-token\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.549015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.548822    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-istio-envoy\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.549015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.548966    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-workload-certs\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.549144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.549017    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkkc2\" (UniqueName: \"kubernetes.io/projected/56977125-2b70-474b-b9a6-f0573841b207-kube-api-access-fkkc2\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.549144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.549045    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56977125-2b70-474b-b9a6-f0573841b207-istiod-ca-cert\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.549144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.549064    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-workload-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.549144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.549086    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56977125-2b70-474b-b9a6-f0573841b207-istio-podinfo\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.549144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.549137    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-istio-data\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.549410 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.549215    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-credential-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.549635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.549576    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-credential-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.550468 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.550439    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-workload-certs\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.553638 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.551441    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-istio-data\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.553638 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.551864    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-workload-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.554191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.554169    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56977125-2b70-474b-b9a6-f0573841b207-istiod-ca-cert\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.556632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.556606    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56977125-2b70-474b-b9a6-f0573841b207-istio-podinfo\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.557867 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.557838    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-istio-envoy\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.611212 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.611183    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56977125-2b70-474b-b9a6-f0573841b207-istio-token\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.611581 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.611561    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkkc2\" (UniqueName: \"kubernetes.io/projected/56977125-2b70-474b-b9a6-f0573841b207-kube-api-access-fkkc2\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:05.721258 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:05.721172    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:06.180783 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:18:06.180740    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56977125_2b70_474b_b9a6_f0573841b207.slice/crio-643267f7824f78d3b388674955969c8edd1d669841c64c13505b1596fc17eb42 WatchSource:0}: Error finding container 643267f7824f78d3b388674955969c8edd1d669841c64c13505b1596fc17eb42: Status 404 returned error can't find the container with id 643267f7824f78d3b388674955969c8edd1d669841c64c13505b1596fc17eb42
Oct 30 22:18:06.182763 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:06.182736    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"]
Oct 30 22:18:06.183972 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:06.183930    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:18:06.184078 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:06.184012    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:18:06.184078 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:06.184056    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:18:06.212960 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:06.212921    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" event={"ID":"56977125-2b70-474b-b9a6-f0573841b207","Type":"ContainerStarted","Data":"643267f7824f78d3b388674955969c8edd1d669841c64c13505b1596fc17eb42"}
Oct 30 22:18:07.222474 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:07.222432    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" event={"ID":"56977125-2b70-474b-b9a6-f0573841b207","Type":"ContainerStarted","Data":"a9784b79cbfcb0962df85ac9611c63496f47f691d40c039cb02587ace88299f3"}
Oct 30 22:18:07.370110 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:07.369569    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podStartSLOduration=2.369547175 podStartE2EDuration="2.369547175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:07.355908817 +0000 UTC m=+1402.086765961" watchObservedRunningTime="2026-10-30 22:18:07.369547175 +0000 UTC m=+1402.100404320"
Oct 30 22:18:07.517693 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:07.517583    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:07.722453 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:07.722413    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:07.724126 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:07.724101    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 22:18:07.724263 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:07.724164    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 22:18:07.811231 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:07.811199    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:08.172710 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:08.172615    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:08.396937 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:08.396903    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:08.721949 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:08.721916    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 22:18:08.722158 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:08.721973    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 22:18:08.788284 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:08.788229    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:09.108811 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:09.108778    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:09.725073 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:09.725016    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 22:18:09.725715 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:09.725667    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 22:18:10.734615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:10.723147    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 22:18:10.734615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:10.723207    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 22:18:10.773830 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:10.773786    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:11.035812 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:11.035706    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:11.071206 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:11.068680    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 22:18:11.162614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:11.161913    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podUID="0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": context deadline exceeded"
Oct 30 22:18:11.211653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:11.211610    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:11.221231 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:11.221188    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:11.242811 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:11.242770    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:11.394724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:11.369130    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 22:18:11.911318 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:11.911275    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:12.011115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.000663    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 30 22:18:12.094737 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.094688    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 22:18:12.102621 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.096554    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 22:18:12.196512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.194500    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:12.196512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.194644    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podUID="0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": context deadline exceeded"
Oct 30 22:18:12.238615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.219025    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:12.238615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.221811    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:12.261752 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.253653    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:12.288626 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.274229    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:12.311693 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.293408    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 22:18:12.311693 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.296641    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": context deadline exceeded"
Oct 30 22:18:12.358624 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.356832    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 22:18:12.404924 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.370540    5258 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:12.404924 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.372426    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 22:18:12.404924 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.372500    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 22:18:12.658903 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.658841    5258 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": context deadline exceeded"
Oct 30 22:18:12.772863 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.772810    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 22:18:12.773173 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.773125    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 22:18:12.940820 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:18:12.940729    5258 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.482s"
Oct 30 22:18:12.942784 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:12.942761    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:18:13.003735 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.003690    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:13.224795 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.224683    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podUID="0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:13.267218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.267156    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:13.280085 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.280034    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:13.292708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.280342    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 22:18:13.342156 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.293970    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:18:13.342485 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.320514    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:13.357880 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.321518    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 30 22:18:13.358139 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.321553    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": context deadline exceeded"
Oct 30 22:18:13.361747 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.321579    5258 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:13.365610 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.340981    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:13.365942 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.342037    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:18:13.380620 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.366175    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv" podUID="f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:13.381222 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.381189    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:13.398406 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.357666    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 22:18:13.412426 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.412383    5258 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": context deadline exceeded"
Oct 30 22:18:13.538819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.512999    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:18:13.711354 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.711323    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:18:13.774617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.753724    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 22:18:13.775036 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:13.774918    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 22:18:14.392609 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.390787    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 30 22:18:14.417781 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.393857    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:18:14.443653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.420182    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"]
Oct 30 22:18:14.446883 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.446842    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podUID="0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": context deadline exceeded"
Oct 30 22:18:14.500615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.497965    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:14.500615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.498345    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:14.504794 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.500916    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:14.540694 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.540646    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:14.606657 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.504117    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": context deadline exceeded"
Oct 30 22:18:14.626619 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.504137    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 22:18:14.626844 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.504156    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": context deadline exceeded"
Oct 30 22:18:14.654673 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.504175    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 30 22:18:14.654673 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:18:14.527303    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:18:14.654673 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.504088    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 22:18:14.774616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.774296    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"]
Oct 30 22:18:14.774616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.774419    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:18:14.774616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.774458    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:18:14.774616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.774547    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:18:14.774616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.774609    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:18:14.806861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.774646    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:18:14.806861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.774680    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:18:14.806861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.783198    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"
Oct 30 22:18:14.822688 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.822650    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:18:14.822954 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.822924    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr" podUID="483ce3ac-7be5-43be-ab91-6b26d13f9f80" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:14.830671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.823800    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 22:18:14.830671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.823846    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 22:18:14.871631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.868511    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwqck\" (UniqueName: \"kubernetes.io/projected/3f53e5af-ef1c-452d-a4cf-acdd899f90f4-kube-api-access-kwqck\") pod \"payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s\" (UID: \"3f53e5af-ef1c-452d-a4cf-acdd899f90f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"
Oct 30 22:18:14.871631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.868676    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f53e5af-ef1c-452d-a4cf-acdd899f90f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s\" (UID: \"3f53e5af-ef1c-452d-a4cf-acdd899f90f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"
Oct 30 22:18:14.980771 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.980670    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwqck\" (UniqueName: \"kubernetes.io/projected/3f53e5af-ef1c-452d-a4cf-acdd899f90f4-kube-api-access-kwqck\") pod \"payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s\" (UID: \"3f53e5af-ef1c-452d-a4cf-acdd899f90f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"
Oct 30 22:18:14.981151 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:14.981124    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f53e5af-ef1c-452d-a4cf-acdd899f90f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s\" (UID: \"3f53e5af-ef1c-452d-a4cf-acdd899f90f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"
Oct 30 22:18:15.355828 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.355760    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:15.356766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.356735    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-73fb6577\""
Oct 30 22:18:15.357144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.357127    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-73fb6577-dockercfg-8t2pl\""
Oct 30 22:18:15.378642 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.360952    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwqck\" (UniqueName: \"kubernetes.io/projected/3f53e5af-ef1c-452d-a4cf-acdd899f90f4-kube-api-access-kwqck\") pod \"payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s\" (UID: \"3f53e5af-ef1c-452d-a4cf-acdd899f90f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"
Oct 30 22:18:15.386611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.383249    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f53e5af-ef1c-452d-a4cf-acdd899f90f4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s\" (UID: \"3f53e5af-ef1c-452d-a4cf-acdd899f90f4\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"
Oct 30 22:18:15.466315 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.455310    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podUID="0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:15.630670 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.577826    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": context deadline exceeded"
Oct 30 22:18:15.630670 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.578633    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 22:18:15.633074 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.633031    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:15.830727 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.633322    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 30 22:18:15.930304 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.689295    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:15.930913 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.698797    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:18:15.931119 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.931089    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2" podUID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:15.931255 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.710763    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 30 22:18:15.934656 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.710722    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": context deadline exceeded"
Oct 30 22:18:15.964613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.846729    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 22:18:16.115072 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.115011    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 22:18:16.126662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:15.771756    5258 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/health\": context deadline exceeded"
Oct 30 22:18:16.181671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.159513    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"
Oct 30 22:18:16.252613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.252523    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:16.259835 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.259794    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:16.264895 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.264847    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 22:18:16.268775 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.268739    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:16.302209 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.302160    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:18:16.305695 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.305569    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" podUID="df963eee-a95d-438b-be00-94119985e1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:16.444724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.420654    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:18:16.444724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.439982    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt" podUID="19b956fb-6a5f-4e18-800b-a94cb43dba93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:16.563012 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.502125    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podUID="0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:16.800825 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.800732    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 22:18:16.801071 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.801045    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 22:18:16.833263 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:18:16.833228    5258 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.454s"
Oct 30 22:18:16.895736 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.895683    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": context deadline exceeded"
Oct 30 22:18:16.896042 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.896011    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 22:18:16.951152 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.951101    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:16.952819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.952776    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 22:18:16.954215 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.954176    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 30 22:18:16.954428 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.954397    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 22:18:16.954600 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.954570    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 30 22:18:16.986011 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:16.985960    5258 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podUID="0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:17.028874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:17.028841    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:17.058287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:17.058241    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:18:17.321669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:17.310182    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:17.321669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:17.310445    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 22:18:17.359669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:17.334236    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 22:18:17.381762 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:17.365552    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:17.502689 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:17.502648    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podUID="0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:17.749747 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:17.749655    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 22:18:17.750370 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:17.750320    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 22:18:17.882401 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:17.882368    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:18.004073 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:17.990052    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:18.004073 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:17.997887    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:18.004073 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:17.997971    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 22:18:18.004073 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:17.998011    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 30 22:18:18.005557 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.005525    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:18.337130 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.337104    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:18:18.362676 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.359119    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": context deadline exceeded"
Oct 30 22:18:18.362676 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.359415    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 22:18:18.381772 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.372791    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:18:18.429149 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.429115    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:18:18.429735 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.429709    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:18.440766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.440745    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:18:18.444772 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.444751    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:18:18.447877 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.447856    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:18:18.476762 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.476732    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:18:18.488840 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.488816    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:18:18.543814 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.543785    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:18:18.615837 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.615752    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:18:18.713428 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.713391    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"]
Oct 30 22:18:18.723857 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.722219    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 22:18:18.723857 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:18.722253    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 22:18:19.721710 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:19.721660    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 30 22:18:19.722115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:19.721740    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 30 22:18:19.727260 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:19.727231    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s" event={"ID":"3f53e5af-ef1c-452d-a4cf-acdd899f90f4","Type":"ContainerStarted","Data":"54290be8a615c5600ca4eb767866cb597b1bcfa9d2afce72ff4b4b589fcb060b"}
Oct 30 22:18:19.727373 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:19.727291    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s" event={"ID":"3f53e5af-ef1c-452d-a4cf-acdd899f90f4","Type":"ContainerStarted","Data":"8396d0a0d4e9470e2700a51c824e419d85001f11337226448a4e19d7d48ca88b"}
Oct 30 22:18:19.727373 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:19.727328    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"
Oct 30 22:18:19.884028 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:19.883973    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s" podStartSLOduration=7.883958306 podStartE2EDuration="7.883958306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:19.861160397 +0000 UTC m=+1414.592017541" watchObservedRunningTime="2026-10-30 22:18:19.883958306 +0000 UTC m=+1414.614815450"
Oct 30 22:18:20.721581 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:20.721529    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:21.762771 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:21.762728    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:18:21.763320 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:21.762800    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:21.913554 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:21.913526    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:21.914638 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:21.914609    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:18:22.275277 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:22.275238    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:23.530491 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:23.530446    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:23.801328 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:23.801184    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:24.034285 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:24.034246    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:24.035884 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:24.035852    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"]
Oct 30 22:18:24.058662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:24.057459    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"
Oct 30 22:18:24.075611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:24.072154    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"]
Oct 30 22:18:24.077439 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:24.077405    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4mpj\" (UniqueName: \"kubernetes.io/projected/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9-kube-api-access-l4mpj\") pod \"payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp\" (UID: \"fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"
Oct 30 22:18:24.077641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:24.077621    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp\" (UID: \"fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"
Oct 30 22:18:24.144746 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:24.142872    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ea4ac3ec\""
Oct 30 22:18:24.197725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:24.193615    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4mpj\" (UniqueName: \"kubernetes.io/projected/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9-kube-api-access-l4mpj\") pod \"payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp\" (UID: \"fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"
Oct 30 22:18:24.197725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:24.193658    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp\" (UID: \"fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"
Oct 30 22:18:24.197725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:24.196136    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp\" (UID: \"fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"
Oct 30 22:18:24.358956 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:24.349240    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4mpj\" (UniqueName: \"kubernetes.io/projected/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9-kube-api-access-l4mpj\") pod \"payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp\" (UID: \"fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"
Oct 30 22:18:24.498201 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:24.498163    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"
Oct 30 22:18:24.893787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:24.893757    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"]
Oct 30 22:18:24.894236 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:18:24.894122    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5ff382_1d2a_46f5_ac45_6aab6c4a27f9.slice/crio-cde1cfd5eb752ff0e110332e6c3a2321b958ee4f9e23045e468943f89e417c85 WatchSource:0}: Error finding container cde1cfd5eb752ff0e110332e6c3a2321b958ee4f9e23045e468943f89e417c85: Status 404 returned error can't find the container with id cde1cfd5eb752ff0e110332e6c3a2321b958ee4f9e23045e468943f89e417c85
Oct 30 22:18:24.950192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:24.950160    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:25.182616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:25.182516    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:25.600688 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:25.600642    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:25.796069 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:25.796030    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp" event={"ID":"fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9","Type":"ContainerStarted","Data":"6aad85020ee4bf5b0e975f5058a484c00e835425dd433fb06ccd89c557050bbc"}
Oct 30 22:18:25.796250 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:25.796098    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp" event={"ID":"fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9","Type":"ContainerStarted","Data":"cde1cfd5eb752ff0e110332e6c3a2321b958ee4f9e23045e468943f89e417c85"}
Oct 30 22:18:25.796250 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:25.796150    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"
Oct 30 22:18:25.917238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:25.916525    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp" podStartSLOduration=2.916507218 podStartE2EDuration="2.916507218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:25.912046116 +0000 UTC m=+1420.642903260" watchObservedRunningTime="2026-10-30 22:18:25.916507218 +0000 UTC m=+1420.647364364"
Oct 30 22:18:27.551182 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:27.551142    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:28.375081 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.375043    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"]
Oct 30 22:18:28.379343 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.379324    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.437702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.437680    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 22:18:28.437828 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.437703    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 22:18:28.437828 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.437701    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 22:18:28.437946 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.437871    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-x7p2g\""
Oct 30 22:18:28.491326 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.491299    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"]
Oct 30 22:18:28.505242 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.505208    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlz62\" (UniqueName: \"kubernetes.io/projected/67564d1b-19b9-4e46-9463-f1b4e6e99439-kube-api-access-rlz62\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.505358 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.505328    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.505470 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.505446    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.505627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.505604    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.505694 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.505649    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/67564d1b-19b9-4e46-9463-f1b4e6e99439-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.505827 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.505805    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.505998 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.505971    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.607423 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.607390    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.607982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.607523    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlz62\" (UniqueName: \"kubernetes.io/projected/67564d1b-19b9-4e46-9463-f1b4e6e99439-kube-api-access-rlz62\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.607982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.607572    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.607982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.607658    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.607982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.607773    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.607982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.607810    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/67564d1b-19b9-4e46-9463-f1b4e6e99439-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.607982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.607889    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.608715 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.608686    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.610654 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.610630    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.611253 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.611221    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/67564d1b-19b9-4e46-9463-f1b4e6e99439-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.611339 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.611312    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.612711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.612691    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.671101 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.671043    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.671276 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.671249    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlz62\" (UniqueName: \"kubernetes.io/projected/67564d1b-19b9-4e46-9463-f1b4e6e99439-kube-api-access-rlz62\") pod \"istiod-openshift-gateway-7ddd9cfdc8-htl7g\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.692426 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.692405    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:28.733961 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.733931    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:28.963914 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:28.963831    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:29.150649 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:29.150617    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"]
Oct 30 22:18:29.152733 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:18:29.152705    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67564d1b_19b9_4e46_9463_f1b4e6e99439.slice/crio-ede06a734d6fb40ad4ba73a92e8a9c7bde8a5faf3994617982c886a3937c8430 WatchSource:0}: Error finding container ede06a734d6fb40ad4ba73a92e8a9c7bde8a5faf3994617982c886a3937c8430: Status 404 returned error can't find the container with id ede06a734d6fb40ad4ba73a92e8a9c7bde8a5faf3994617982c886a3937c8430
Oct 30 22:18:29.155731 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:29.155712    5258 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:18:29.884584 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:29.884548    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g" event={"ID":"67564d1b-19b9-4e46-9463-f1b4e6e99439","Type":"ContainerStarted","Data":"ede06a734d6fb40ad4ba73a92e8a9c7bde8a5faf3994617982c886a3937c8430"}
Oct 30 22:18:30.738322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:30.738291    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"
Oct 30 22:18:31.829253 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:31.829195    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:32.799565 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:32.798034    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:32.847233 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:32.847199    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:18:32.847535 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:32.847270    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:18:33.024105 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:33.024067    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:33.927466 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:33.927428    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g" event={"ID":"67564d1b-19b9-4e46-9463-f1b4e6e99439","Type":"ContainerStarted","Data":"6cdaa4216a7c264cdb1692caa6c488d68d6729c322e0498b17885788b78b2d8d"}
Oct 30 22:18:33.927935 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:33.927624    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:33.929203 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:33.929177    5258 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-htl7g container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:18:33.929319 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:33.929216    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g" podUID="67564d1b-19b9-4e46-9463-f1b4e6e99439" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:18:34.099670 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:34.099613    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g" podStartSLOduration=2.409785843 podStartE2EDuration="6.099598953s" totalImagesPullingTime="3.68981311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:34.048929819 +0000 UTC m=+1428.779786962" watchObservedRunningTime="2026-10-30 22:18:34.099598953 +0000 UTC m=+1428.830456086"
Oct 30 22:18:34.938850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:34.938812    5258 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-htl7g container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:18:34.939326 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:34.938878    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g" podUID="67564d1b-19b9-4e46-9463-f1b4e6e99439" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:18:35.661988 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.661953    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"]
Oct 30 22:18:35.666709 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.666686    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.745236 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.745202    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-workload-certs\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.745391 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.745262    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc12b5a9-3464-4559-8834-01492f373f25-istio-podinfo\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.745391 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.745379    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddmc7\" (UniqueName: \"kubernetes.io/projected/cc12b5a9-3464-4559-8834-01492f373f25-kube-api-access-ddmc7\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.745477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.745449    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-workload-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.745538 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.745519    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc12b5a9-3464-4559-8834-01492f373f25-istio-token\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.745597 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.745564    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc12b5a9-3464-4559-8834-01492f373f25-istiod-ca-cert\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.745710 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.745688    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-istio-data\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.745830 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.745810    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-istio-envoy\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.745907 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.745891    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-credential-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.776130 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.776101    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"]
Oct 30 22:18:35.847433 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.847403    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-credential-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.847565 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.847503    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-workload-certs\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.847565 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.847530    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc12b5a9-3464-4559-8834-01492f373f25-istio-podinfo\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.847565 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.847559    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddmc7\" (UniqueName: \"kubernetes.io/projected/cc12b5a9-3464-4559-8834-01492f373f25-kube-api-access-ddmc7\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.847875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.847585    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-workload-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.847875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.847631    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc12b5a9-3464-4559-8834-01492f373f25-istio-token\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.847875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.847715    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc12b5a9-3464-4559-8834-01492f373f25-istiod-ca-cert\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.847875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.847785    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-istio-data\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.847875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.847870    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-istio-envoy\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.848151 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.847915    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-credential-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.848151 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.847960    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-workload-certs\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.848251 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.848158    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-workload-socket\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.848314 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.848298    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-istio-data\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.848488 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.848456    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc12b5a9-3464-4559-8834-01492f373f25-istiod-ca-cert\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.849998 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.849977    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-istio-envoy\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.850126 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.850109    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc12b5a9-3464-4559-8834-01492f373f25-istio-podinfo\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.911177 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.911146    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddmc7\" (UniqueName: \"kubernetes.io/projected/cc12b5a9-3464-4559-8834-01492f373f25-kube-api-access-ddmc7\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.911757 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.911737    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc12b5a9-3464-4559-8834-01492f373f25-istio-token\") pod \"e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") " pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:35.982454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:35.982392    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:36.427747 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:18:36.427718    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc12b5a9_3464_4559_8834_01492f373f25.slice/crio-562228c68d3061ae1755fadb854f89c10095d4532425dc9788b8be43ff4ff700 WatchSource:0}: Error finding container 562228c68d3061ae1755fadb854f89c10095d4532425dc9788b8be43ff4ff700: Status 404 returned error can't find the container with id 562228c68d3061ae1755fadb854f89c10095d4532425dc9788b8be43ff4ff700
Oct 30 22:18:36.429425 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:36.429347    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"]
Oct 30 22:18:36.430371 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:36.430339    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:18:36.430440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:36.430400    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:18:36.430440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:36.430428    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:18:36.807824 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:36.807784    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"
Oct 30 22:18:36.880725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:36.880661    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:36.976148 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:36.976103    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv" event={"ID":"cc12b5a9-3464-4559-8834-01492f373f25","Type":"ContainerStarted","Data":"d5151c9a59c92c8374cfa9f8f90d7f910ae221901caa25b02a1dabc4856cea43"}
Oct 30 22:18:36.976406 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:36.976176    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv" event={"ID":"cc12b5a9-3464-4559-8834-01492f373f25","Type":"ContainerStarted","Data":"562228c68d3061ae1755fadb854f89c10095d4532425dc9788b8be43ff4ff700"}
Oct 30 22:18:36.987645 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:36.984654    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:37.117664 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:37.116731    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv" podStartSLOduration=2.116712598 podStartE2EDuration="2.116712598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:37.10748731 +0000 UTC m=+1431.838344472" watchObservedRunningTime="2026-10-30 22:18:37.116712598 +0000 UTC m=+1431.847569742"
Oct 30 22:18:37.939083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:37.939050    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:18:37.984514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:37.984471    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:18:37.984751 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:37.984540    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv" podUID="cc12b5a9-3464-4559-8834-01492f373f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 22:18:38.023372 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:38.023332    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:38.983373 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:38.983340    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:18:38.983553 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:38.983405    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv" podUID="cc12b5a9-3464-4559-8834-01492f373f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 22:18:39.134646 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:39.134572    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:39.983248 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:39.983211    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:18:39.983529 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:39.983279    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv" podUID="cc12b5a9-3464-4559-8834-01492f373f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 22:18:40.983140 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:40.983098    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:18:40.983683 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:40.983172    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv" podUID="cc12b5a9-3464-4559-8834-01492f373f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 22:18:41.987864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:41.987115    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:18:41.987864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:41.987189    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv" podUID="cc12b5a9-3464-4559-8834-01492f373f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 22:18:42.983440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:42.983399    5258 patch_prober.go:29] interesting pod/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:18:42.983668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:42.983478    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv" podUID="cc12b5a9-3464-4559-8834-01492f373f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 22:18:43.173773 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:18:43.173729    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:18:43.248728 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:43.248567    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:43.464938 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:43.464875    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:43.734081 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:43.734035    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:44.075095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:44.073725    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:44.075095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:44.075010    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:44.076270 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:44.076245    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:18:45.631079 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:45.631051    5258 scope.go:122] "RemoveContainer" containerID="05b5823e4837ee5704efd9a5796c1e707aff4ff6466c582a68d0d01fa3956ea3"
Oct 30 22:18:48.677693 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:48.677654    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:49.008820 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:49.008728    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:18:51.913614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:51.912687    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:51.936707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:51.936661    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:51.937232 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:51.937200    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 30 22:18:51.959849 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:51.959814    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:51.961488 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:51.961155    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:52.277492 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.275691    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:52.277492 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.276054    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": context deadline exceeded"
Oct 30 22:18:52.343293 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.343250    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:52.344473 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.344439    5258 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:52.487841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.487712    5258 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/health\": context deadline exceeded"
Oct 30 22:18:52.491611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.488234    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podUID="0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:52.597614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.588234    5258 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:52.902222 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.898723    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:52.918028 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.917986    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:52.919035 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.919011    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:18:52.961709 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.961665    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 22:18:52.962110 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.962068    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": context deadline exceeded"
Oct 30 22:18:53.002722 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.965063    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:53.136919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.981857    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" probeResult="failure" output="Get \"https://10.132.0.93:8000/ready\": context deadline exceeded"
Oct 30 22:18:53.136919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.981889    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 22:18:53.136919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:52.987676    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:18:53.136919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.132913    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:18:53.136919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.132959    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:18:53.136919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.132994    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:18:53.279870 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.279760    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:53.280358 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.280326    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 30 22:18:53.281885 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.281864    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:18:53.282086 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.282062    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:18:53.304944 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.304905    5258 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:53.384063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.354283    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 30 22:18:53.490460 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.490416    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k" podUID="0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:53.502932 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.502902    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:18:53.503222 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.503165    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:18:53.625650 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.622261    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:18:53.706007 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.705977    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:18:53.722611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.719038    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:18:53.844682 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.844655    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:18:53.937768 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.937680    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:53.964653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.940651    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:53.968889 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.946398    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:18:53.969106 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.969091    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:18:53.970230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.970201    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:18:53.984332 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.982622    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:18:53.984526 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:53.984510    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k"
Oct 30 22:18:54.106664 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:54.101192    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:18:54.114055 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:54.114031    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:18:54.134310 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:54.134281    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:18:56.539186 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:56.538979    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:56.763065 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:56.763029    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:59.617910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:59.617872    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:59.882636 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:18:59.882523    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:00.153088 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:00.152991    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:04.821643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:04.821608    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:05.051061 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:05.051027    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:05.799782 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:05.799745    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:10.172229 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:10.172187    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:13.161984 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:19:13.161935    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:19:15.190461 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:15.190422    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:20.195713 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:20.195674    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:23.762010 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:23.761982    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:25.294981 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:25.294939    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:30.376707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:30.376665    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:35.442900 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:35.442862    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:40.647637 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:40.647530    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:43.165276 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:19:43.165236    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:19:43.279053 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:43.279006    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:43.497964 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:43.497848    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:45.598840 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:45.598804    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:19:45.600112 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:45.600094    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:19:45.698399 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:45.698321    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:51.283877 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:51.283781    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:56.643182 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:19:56.643143    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:01.906128 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:01.906087    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:02.187062 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:02.186956    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:03.112341 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:03.112311    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:20:03.620886 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:03.620847    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"]
Oct 30 22:20:03.943446 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:03.943333    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:04.176644 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:04.175967    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:07.884251 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:07.884206    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:08.621786 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:08.621726    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s" podUID="3f53e5af-ef1c-452d-a4cf-acdd899f90f4" containerName="payload-pre-processing" containerID="cri-o://54290be8a615c5600ca4eb767866cb597b1bcfa9d2afce72ff4b4b589fcb060b" gracePeriod=25
Oct 30 22:20:08.911021 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:08.910938    5258 generic.go:356] "Generic (PLEG): container finished" podID="3f53e5af-ef1c-452d-a4cf-acdd899f90f4" containerID="54290be8a615c5600ca4eb767866cb597b1bcfa9d2afce72ff4b4b589fcb060b" exitCode=0
Oct 30 22:20:08.911414 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:08.911018    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s" event={"ID":"3f53e5af-ef1c-452d-a4cf-acdd899f90f4","Type":"ContainerDied","Data":"54290be8a615c5600ca4eb767866cb597b1bcfa9d2afce72ff4b4b589fcb060b"}
Oct 30 22:20:08.965923 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:08.965892    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"
Oct 30 22:20:09.066136 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:09.066104    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f53e5af-ef1c-452d-a4cf-acdd899f90f4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f53e5af-ef1c-452d-a4cf-acdd899f90f4-plugins-config-volume\") pod \"3f53e5af-ef1c-452d-a4cf-acdd899f90f4\" (UID: \"3f53e5af-ef1c-452d-a4cf-acdd899f90f4\") "
Oct 30 22:20:09.066314 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:09.066257    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f53e5af-ef1c-452d-a4cf-acdd899f90f4-kube-api-access-kwqck\" (UniqueName: \"kubernetes.io/projected/3f53e5af-ef1c-452d-a4cf-acdd899f90f4-kube-api-access-kwqck\") pod \"3f53e5af-ef1c-452d-a4cf-acdd899f90f4\" (UID: \"3f53e5af-ef1c-452d-a4cf-acdd899f90f4\") "
Oct 30 22:20:09.066521 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:09.066495    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f53e5af-ef1c-452d-a4cf-acdd899f90f4-plugins-config-volume" pod "3f53e5af-ef1c-452d-a4cf-acdd899f90f4" (UID: "3f53e5af-ef1c-452d-a4cf-acdd899f90f4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:20:09.066859 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:09.066842    5258 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f53e5af-ef1c-452d-a4cf-acdd899f90f4-plugins-config-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:09.069470 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:09.069438    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f53e5af-ef1c-452d-a4cf-acdd899f90f4-kube-api-access-kwqck" pod "3f53e5af-ef1c-452d-a4cf-acdd899f90f4" (UID: "3f53e5af-ef1c-452d-a4cf-acdd899f90f4"). InnerVolumeSpecName "kube-api-access-kwqck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:20:09.168474 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:09.168392    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwqck\" (UniqueName: \"kubernetes.io/projected/3f53e5af-ef1c-452d-a4cf-acdd899f90f4-kube-api-access-kwqck\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:09.920431 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:09.920401    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"
Oct 30 22:20:09.920918 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:09.920439    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s" event={"ID":"3f53e5af-ef1c-452d-a4cf-acdd899f90f4","Type":"ContainerDied","Data":"8396d0a0d4e9470e2700a51c824e419d85001f11337226448a4e19d7d48ca88b"}
Oct 30 22:20:09.920918 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:09.920500    5258 scope.go:122] "RemoveContainer" containerID="54290be8a615c5600ca4eb767866cb597b1bcfa9d2afce72ff4b4b589fcb060b"
Oct 30 22:20:10.092725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:10.092690    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"]
Oct 30 22:20:10.142009 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:10.141971    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-73fb6577-647c64c8f5-hqm2s"]
Oct 30 22:20:10.557113 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:10.557074    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:11.383470 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:11.383437    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3f53e5af-ef1c-452d-a4cf-acdd899f90f4" path="/var/lib/kubelet/pods/3f53e5af-ef1c-452d-a4cf-acdd899f90f4/volumes"
Oct 30 22:20:13.161981 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:20:13.161944    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:20:13.489293 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:13.489196    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:15.769537 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:15.769507    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"]
Oct 30 22:20:16.160672 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:16.160637    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:16.402471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:16.402428    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:18.298623 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:18.298507    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:18.594730 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:18.594148    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:18.815776 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:18.815734    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:20.770235 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:20.770200    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp" podUID="fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9" containerName="payload-pre-processing" containerID="cri-o://6aad85020ee4bf5b0e975f5058a484c00e835425dd433fb06ccd89c557050bbc" gracePeriod=25
Oct 30 22:20:21.039006 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:21.038974    5258 generic.go:356] "Generic (PLEG): container finished" podID="fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9" containerID="6aad85020ee4bf5b0e975f5058a484c00e835425dd433fb06ccd89c557050bbc" exitCode=0
Oct 30 22:20:21.039155 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:21.039057    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp" event={"ID":"fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9","Type":"ContainerDied","Data":"6aad85020ee4bf5b0e975f5058a484c00e835425dd433fb06ccd89c557050bbc"}
Oct 30 22:20:21.065258 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:21.065236    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"
Oct 30 22:20:21.115021 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:21.114989    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9-plugins-config-volume\") pod \"fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9\" (UID: \"fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9\") "
Oct 30 22:20:21.115167 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:21.115078    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9-kube-api-access-l4mpj\" (UniqueName: \"kubernetes.io/projected/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9-kube-api-access-l4mpj\") pod \"fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9\" (UID: \"fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9\") "
Oct 30 22:20:21.115444 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:21.115414    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9-plugins-config-volume" pod "fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9" (UID: "fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:20:21.115947 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:21.115924    5258 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9-plugins-config-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:21.117264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:21.117237    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9-kube-api-access-l4mpj" pod "fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9" (UID: "fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9"). InnerVolumeSpecName "kube-api-access-l4mpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:20:21.217967 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:21.217934    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4mpj\" (UniqueName: \"kubernetes.io/projected/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9-kube-api-access-l4mpj\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:20:22.053585 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:22.053543    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"
Oct 30 22:20:22.054158 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:22.053727    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp" event={"ID":"fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9","Type":"ContainerDied","Data":"cde1cfd5eb752ff0e110332e6c3a2321b958ee4f9e23045e468943f89e417c85"}
Oct 30 22:20:22.054158 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:22.053815    5258 scope.go:122] "RemoveContainer" containerID="6aad85020ee4bf5b0e975f5058a484c00e835425dd433fb06ccd89c557050bbc"
Oct 30 22:20:22.224961 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:22.224931    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"]
Oct 30 22:20:22.276378 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:22.276348    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ea4ac3ec-7cf444d99-w54wp"]
Oct 30 22:20:22.890746 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:22.890699    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:23.107540 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:23.107502    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:23.384780 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:23.384722    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9" path="/var/lib/kubelet/pods/fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9/volumes"
Oct 30 22:20:23.903549 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:23.903513    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:24.173896 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:24.173810    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:24.415961 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:24.415924    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:25.941635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:25.941532    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:29.165483 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:29.165449    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:34.162301 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:34.162262    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:38.619512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:38.619475    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:40.263755 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:40.263713    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:40.545841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:40.545756    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:40.835068 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:40.835030    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:41.062850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:41.062808    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:41.813241 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:41.813202    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:42.035076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:42.035027    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:42.261946 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:42.261858    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:43.147291 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:43.147036    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:43.221623 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:20:43.219893    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:20:43.457232 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:43.457142    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:46.168696 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:46.168658    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:46.959079 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:46.959042    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:47.233118 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:47.233038    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:49.652085 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:49.652048    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:49.877025 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:49.876977    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:51.165644 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:51.165607    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:52.673004 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:52.672967    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:53.119782 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.119749    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:53.190640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.190584    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"]
Oct 30 22:20:53.192300 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.192254    5258 cpu_manager.go:414] "containerMap: removing container" podUID="3f53e5af-ef1c-452d-a4cf-acdd899f90f4" containerName="payload-pre-processing"
Oct 30 22:20:53.192545 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.192528    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f53e5af-ef1c-452d-a4cf-acdd899f90f4" containerName="payload-pre-processing"
Oct 30 22:20:53.192728 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.192714    5258 cpu_manager.go:414] "containerMap: removing container" podUID="fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9" containerName="payload-pre-processing"
Oct 30 22:20:53.192821 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.192809    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9" containerName="payload-pre-processing"
Oct 30 22:20:53.193192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.193173    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa5ff382-1d2a-46f5-ac45-6aab6c4a27f9" containerName="payload-pre-processing"
Oct 30 22:20:53.193327 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.193315    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f53e5af-ef1c-452d-a4cf-acdd899f90f4" containerName="payload-pre-processing"
Oct 30 22:20:53.226414 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.223768    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.290543 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.290493    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"]
Oct 30 22:20:53.365410 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.365378    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vq85\" (UniqueName: \"kubernetes.io/projected/9540d501-45f8-42fb-b3e3-da60a19f9301-kube-api-access-5vq85\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.365635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.365511    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.365635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.365566    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.365734 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.365717    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9540d501-45f8-42fb-b3e3-da60a19f9301-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.365776 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.365764    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.365818 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.365791    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.365899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.365874    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9540d501-45f8-42fb-b3e3-da60a19f9301-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.365943 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.365933    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9540d501-45f8-42fb-b3e3-da60a19f9301-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.366009 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.365995    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.470580 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.470488    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.472227 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.472204    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vq85\" (UniqueName: \"kubernetes.io/projected/9540d501-45f8-42fb-b3e3-da60a19f9301-kube-api-access-5vq85\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.473764 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.473741    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.474659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.474370    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.475085 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.471946    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.475302 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.475281    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.475789 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.475773    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9540d501-45f8-42fb-b3e3-da60a19f9301-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.476396 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.476377    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.483490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.483464    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.484307 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.479448    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.484448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.483335    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9540d501-45f8-42fb-b3e3-da60a19f9301-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.484533 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.475669    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.484749 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.484664    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9540d501-45f8-42fb-b3e3-da60a19f9301-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.485705 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.485684    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9540d501-45f8-42fb-b3e3-da60a19f9301-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.485889 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.485624    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9540d501-45f8-42fb-b3e3-da60a19f9301-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.488289 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.488260    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:53.489808 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.489105    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9540d501-45f8-42fb-b3e3-da60a19f9301-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.544634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.544584    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vq85\" (UniqueName: \"kubernetes.io/projected/9540d501-45f8-42fb-b3e3-da60a19f9301-kube-api-access-5vq85\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.548265 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.548223    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9540d501-45f8-42fb-b3e3-da60a19f9301-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-shttj\" (UID: \"9540d501-45f8-42fb-b3e3-da60a19f9301\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:53.844667 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:53.844164    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:54.353821 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:54.353791    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"]
Oct 30 22:20:54.354461 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:20:54.354428    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9540d501_45f8_42fb_b3e3_da60a19f9301.slice/crio-2d51860d93a6a951827f8640a3bfcb642276c45eb9404598bdd0938c1f9da505 WatchSource:0}: Error finding container 2d51860d93a6a951827f8640a3bfcb642276c45eb9404598bdd0938c1f9da505: Status 404 returned error can't find the container with id 2d51860d93a6a951827f8640a3bfcb642276c45eb9404598bdd0938c1f9da505
Oct 30 22:20:54.355601 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:54.355556    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:54.357359 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:54.357325    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:20:54.357453 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:54.357407    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:20:54.357453 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:54.357446    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:20:54.502125 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:54.501228    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj" event={"ID":"9540d501-45f8-42fb-b3e3-da60a19f9301","Type":"ContainerStarted","Data":"2d51860d93a6a951827f8640a3bfcb642276c45eb9404598bdd0938c1f9da505"}
Oct 30 22:20:54.631341 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:54.631250    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:54.991877 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:54.989916    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:55.228428 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:55.228396    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:55.511167 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:55.511131    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj" event={"ID":"9540d501-45f8-42fb-b3e3-da60a19f9301","Type":"ContainerStarted","Data":"9c48a8a0972b884cee2d2af0591299d09cf94f389a1abf7cf7a12622722296b0"}
Oct 30 22:20:55.718610 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:55.710279    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:55.741653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:55.730185    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj" podStartSLOduration=2.730061304 podStartE2EDuration="2.730061304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:20:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:20:55.710979834 +0000 UTC m=+1570.441836979" watchObservedRunningTime="2026-10-30 22:20:55.730061304 +0000 UTC m=+1570.460918455"
Oct 30 22:20:55.849664 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:55.846908    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:20:55.849945 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:55.849067    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-shttj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:20:55.850989 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:55.850957    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj" podUID="9540d501-45f8-42fb-b3e3-da60a19f9301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 22:20:56.506682 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:56.505528    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:56.808224 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:56.807951    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:56.844896 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:56.844857    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-shttj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:20:56.845061 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:56.844917    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj" podUID="9540d501-45f8-42fb-b3e3-da60a19f9301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 22:20:57.789983 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:57.789932    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:57.850042 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:57.850000    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-shttj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:20:57.850353 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:57.850321    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj" podUID="9540d501-45f8-42fb-b3e3-da60a19f9301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 22:20:58.039285 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:58.038408    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:58.845155 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:58.845116    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-shttj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:20:58.845559 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:58.845179    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj" podUID="9540d501-45f8-42fb-b3e3-da60a19f9301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 22:20:59.844409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:59.844376    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-shttj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:20:59.844627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:59.844429    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj" podUID="9540d501-45f8-42fb-b3e3-da60a19f9301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 22:20:59.940888 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:20:59.940847    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:00.167451 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:00.167357    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:00.844997 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:00.844954    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-shttj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:21:00.845173 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:00.845026    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj" podUID="9540d501-45f8-42fb-b3e3-da60a19f9301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 22:21:01.126184 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:01.126101    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:21:01.399404 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:01.399314    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:01.844556 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:01.844519    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-shttj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:21:01.844742 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:01.844612    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj" podUID="9540d501-45f8-42fb-b3e3-da60a19f9301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 22:21:02.844535 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:02.844498    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-shttj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused" start-of-body=
Oct 30 22:21:02.845016 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:02.844560    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj" podUID="9540d501-45f8-42fb-b3e3-da60a19f9301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": dial tcp 10.132.0.111:15021: connect: connection refused"
Oct 30 22:21:03.282855 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:03.282768    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:03.677022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:03.676990    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:04.368613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:04.366954    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:21:04.381556 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:04.378372    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:21:04.381556 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:04.379184    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj"
Oct 30 22:21:07.577217 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:07.575149    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:08.296152 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.296121    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"]
Oct 30 22:21:08.299782 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.299762    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.406027 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.405982    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"]
Oct 30 22:21:08.447288 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.447246    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.447491 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.447459    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.447562 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.447536    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.447648 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.447617    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.447816 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.447794    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.447884 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.447839    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.448074 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.448054    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.448159 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.448142    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.448279 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.448234    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdnvz\" (UniqueName: \"kubernetes.io/projected/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-kube-api-access-gdnvz\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.549547 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.549460    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.549547 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.549513    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdnvz\" (UniqueName: \"kubernetes.io/projected/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-kube-api-access-gdnvz\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.549789 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.549719    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.549850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.549827    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.549912 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.549874    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.549972 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.549903    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.549972 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.549914    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.550082 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.550010    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.550082 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.550047    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.550186 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.550112    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.550238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.550212    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.550321 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.550299    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.550441 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.550422    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.550541 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.550524    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.552853 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.552829    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.552952 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.552867    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.612187 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.612160    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.612577 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.612284    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdnvz\" (UniqueName: \"kubernetes.io/projected/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-kube-api-access-gdnvz\") pod \"maas-default-gateway-openshift-default-76597d6855-47fwf\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:08.615076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:08.615052    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:09.063447 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:09.063410    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"]
Oct 30 22:21:09.064078 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:21:09.064055    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3718bc80_ba6b_49d4_8f03_b6cfe01588e1.slice/crio-06056d0873648bf6487f21782bc72c0d4eaeadc1c40a41606ec5fdaa8e3f8c2e WatchSource:0}: Error finding container 06056d0873648bf6487f21782bc72c0d4eaeadc1c40a41606ec5fdaa8e3f8c2e: Status 404 returned error can't find the container with id 06056d0873648bf6487f21782bc72c0d4eaeadc1c40a41606ec5fdaa8e3f8c2e
Oct 30 22:21:09.067690 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:09.067651    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:21:09.067798 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:09.067719    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:21:09.067798 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:09.067749    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:21:09.678947 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:09.677244    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf" event={"ID":"3718bc80-ba6b-49d4-8f03-b6cfe01588e1","Type":"ContainerStarted","Data":"982c33977300ff0a2658a296197b109fa44d6e7416c3b7596dc38a7263618251"}
Oct 30 22:21:09.678947 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:09.677331    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf" event={"ID":"3718bc80-ba6b-49d4-8f03-b6cfe01588e1","Type":"ContainerStarted","Data":"06056d0873648bf6487f21782bc72c0d4eaeadc1c40a41606ec5fdaa8e3f8c2e"}
Oct 30 22:21:09.803414 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:09.803353    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf" podStartSLOduration=1.803334878 podStartE2EDuration="1.803334878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:21:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:21:09.80117497 +0000 UTC m=+1584.532032117" watchObservedRunningTime="2026-10-30 22:21:09.803334878 +0000 UTC m=+1584.534192023"
Oct 30 22:21:10.615627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:10.615578    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:10.617367 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:10.617345    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-47fwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 22:21:10.617423 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:10.617407    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf" podUID="3718bc80-ba6b-49d4-8f03-b6cfe01588e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 22:21:11.616380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:11.616339    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-47fwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 22:21:11.616788 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:11.616390    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf" podUID="3718bc80-ba6b-49d4-8f03-b6cfe01588e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 22:21:12.620697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:12.620048    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-47fwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 22:21:12.620697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:12.620114    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf" podUID="3718bc80-ba6b-49d4-8f03-b6cfe01588e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 22:21:12.626607 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:12.626552    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:13.192292 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:21:13.192251    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:21:13.616129 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:13.616087    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-47fwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 22:21:13.616304 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:13.616139    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf" podUID="3718bc80-ba6b-49d4-8f03-b6cfe01588e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 22:21:14.616032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:14.615996    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-47fwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 22:21:14.616404 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:14.616074    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf" podUID="3718bc80-ba6b-49d4-8f03-b6cfe01588e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 22:21:15.615477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:15.615438    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-47fwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 22:21:15.615704 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:15.615497    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf" podUID="3718bc80-ba6b-49d4-8f03-b6cfe01588e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 22:21:16.615748 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:16.615707    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-47fwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 22:21:16.616159 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:16.615788    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf" podUID="3718bc80-ba6b-49d4-8f03-b6cfe01588e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 22:21:17.816026 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:17.814774    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:18.172910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:18.172812    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:18.176015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:18.175843    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:18.180385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:18.180358    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:21:19.920537 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:19.920498    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:22.809945 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:22.809912    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:24.573628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:24.573574    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:27.011458 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:27.011419    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:27.873320 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:27.873282    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:33.012012 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:33.011971    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:33.267683 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:33.267567    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:34.759282 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:34.759008    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:35.432339 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:35.431866    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:36.031255 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:36.031220    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:38.695508 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:38.695458    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:40.920211 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:40.920173    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:41.368130 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.368095    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:41.643340 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.643245    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:41.792351 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.792306    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"]
Oct 30 22:21:41.797324 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.797297    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.838955 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.838912    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istiod-ca-cert\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.839146 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.839091    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grvmx\" (UniqueName: \"kubernetes.io/projected/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-kube-api-access-grvmx\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.839282 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.839254    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-workload-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.839354 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.839329    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-token\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.839411 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.839392    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-workload-certs\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.839491 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.839476    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-envoy\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.839582 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.839568    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-data\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.839679 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.839606    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-podinfo\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.839679 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.839637    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-credential-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.864487 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.864450    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"]
Oct 30 22:21:41.903863 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.903781    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-367f4491-openshift-default-dockercfg-d7tpf\""
Oct 30 22:21:41.971246 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.971199    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-workload-certs\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.971800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.971316    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-envoy\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.971800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.971424    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-data\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.971800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.971452    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-podinfo\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.971800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.971482    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-credential-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.971800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.971538    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istiod-ca-cert\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.971800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.971746    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grvmx\" (UniqueName: \"kubernetes.io/projected/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-kube-api-access-grvmx\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.978078 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.978016    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-workload-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.978331 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.978133    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-token\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:41.999320 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:41.999284    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-workload-certs\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:42.003019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.002980    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-credential-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:42.027661 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.003584    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-workload-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:42.027950 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.004165    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istiod-ca-cert\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:42.028083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.004533    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-data\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:42.028196 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.005107    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:42.040701 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.035445    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-envoy\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:42.041879 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.041709    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-podinfo\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:42.046389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.046360    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-token\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:42.071471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.071396    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grvmx\" (UniqueName: \"kubernetes.io/projected/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-kube-api-access-grvmx\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:42.117894 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.117861    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:42.465362 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.465227    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:42.613004 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.612971    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"]
Oct 30 22:21:42.613579 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:21:42.613556    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b85f08_4ff4_4a51_b6fd_59a2a5600b78.slice/crio-376ca8497c3c70f2cd50d0cd1b8d2486a4562b0617e04efb6ec826317c00878e WatchSource:0}: Error finding container 376ca8497c3c70f2cd50d0cd1b8d2486a4562b0617e04efb6ec826317c00878e: Status 404 returned error can't find the container with id 376ca8497c3c70f2cd50d0cd1b8d2486a4562b0617e04efb6ec826317c00878e
Oct 30 22:21:42.616178 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.616143    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:21:42.616287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.616224    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:21:42.616287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:42.616267    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:21:43.198986 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:43.198936    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh" event={"ID":"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78","Type":"ContainerStarted","Data":"ea7f4b5f439ecf9225daa03d384abfde1247ed3911d13b81aff2b8780f2aa3a6"}
Oct 30 22:21:43.199500 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:43.199004    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh" event={"ID":"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78","Type":"ContainerStarted","Data":"376ca8497c3c70f2cd50d0cd1b8d2486a4562b0617e04efb6ec826317c00878e"}
Oct 30 22:21:43.284861 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:21:43.284826    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:21:43.326113 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:43.326053    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh" podStartSLOduration=2.326039039 podStartE2EDuration="2.326039039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:21:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:21:43.320575116 +0000 UTC m=+1618.051432264" watchObservedRunningTime="2026-10-30 22:21:43.326039039 +0000 UTC m=+1618.056896179"
Oct 30 22:21:44.118348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:44.118303    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:44.125744 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:44.125700    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:44.206904 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:44.206872    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:44.207828 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:44.207807    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:21:44.562675 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:44.560201    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:44.800056 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:44.799951    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:45.034099 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:45.034007    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:46.313447 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:46.313406    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:46.582134 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:46.582030    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:49.225555 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:49.225513    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:49.632389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:49.632345    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:49.956259 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:49.956001    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:50.022102 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.022049    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"]
Oct 30 22:21:50.053016 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.034839    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"
Oct 30 22:21:50.057063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.057031    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"]
Oct 30 22:21:50.089043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.088305    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:50.097613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.093845    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-367f4491\""
Oct 30 22:21:50.101619 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.099868    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-367f4491-dockercfg-x2sfw\""
Oct 30 22:21:50.194647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.184423    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-maas-api-tls\") pod \"maas-api-e2e-derive-678b1628-58bd89844d-jcz92\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:50.194647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.184565    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee19ff52-f6e8-4ebd-af0c-d8385855d860-openshift-service-ca\") pod \"maas-api-e2e-derive-678b1628-58bd89844d-jcz92\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:50.194647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.184612    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-metrics-certs\") pod \"maas-api-e2e-derive-678b1628-58bd89844d-jcz92\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:50.194647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.184644    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wz2w\" (UniqueName: \"kubernetes.io/projected/ee19ff52-f6e8-4ebd-af0c-d8385855d860-kube-api-access-8wz2w\") pod \"maas-api-e2e-derive-678b1628-58bd89844d-jcz92\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:50.194647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.184758    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dd33760-037c-41b0-848d-50c297665fd8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9\" (UID: \"9dd33760-037c-41b0-848d-50c297665fd8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"
Oct 30 22:21:50.194647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.184940    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njjqf\" (UniqueName: \"kubernetes.io/projected/9dd33760-037c-41b0-848d-50c297665fd8-kube-api-access-njjqf\") pod \"payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9\" (UID: \"9dd33760-037c-41b0-848d-50c297665fd8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"
Oct 30 22:21:50.194647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.190509    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:50.223660 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.217389    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"]
Oct 30 22:21:50.223660 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.217468    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"]
Oct 30 22:21:50.257284 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.254824    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-678b1628-serving-cert\""
Oct 30 22:21:50.287636 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.287537    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wz2w\" (UniqueName: \"kubernetes.io/projected/ee19ff52-f6e8-4ebd-af0c-d8385855d860-kube-api-access-8wz2w\") pod \"maas-api-e2e-derive-678b1628-58bd89844d-jcz92\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:50.287827 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.287688    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dd33760-037c-41b0-848d-50c297665fd8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9\" (UID: \"9dd33760-037c-41b0-848d-50c297665fd8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"
Oct 30 22:21:50.287900 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.287859    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njjqf\" (UniqueName: \"kubernetes.io/projected/9dd33760-037c-41b0-848d-50c297665fd8-kube-api-access-njjqf\") pod \"payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9\" (UID: \"9dd33760-037c-41b0-848d-50c297665fd8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"
Oct 30 22:21:50.288013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.287993    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-maas-api-tls\") pod \"maas-api-e2e-derive-678b1628-58bd89844d-jcz92\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:50.288118 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.288103    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee19ff52-f6e8-4ebd-af0c-d8385855d860-openshift-service-ca\") pod \"maas-api-e2e-derive-678b1628-58bd89844d-jcz92\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:50.288189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.288131    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-metrics-certs\") pod \"maas-api-e2e-derive-678b1628-58bd89844d-jcz92\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:50.299911 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.296833    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-metrics-certs\") pod \"maas-api-e2e-derive-678b1628-58bd89844d-jcz92\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:50.299911 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.297872    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dd33760-037c-41b0-848d-50c297665fd8-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9\" (UID: \"9dd33760-037c-41b0-848d-50c297665fd8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"
Oct 30 22:21:50.299911 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:21:50.298177    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-serving-cert: secret "maas-api-e2e-derive-678b1628-serving-cert" not found
Oct 30 22:21:50.299911 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:21:50.298235    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-maas-api-tls podName:ee19ff52-f6e8-4ebd-af0c-d8385855d860 nodeName:}" failed. No retries permitted until 2026-10-30 22:21:50.798216782 +0000 UTC m=+1625.529073907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-maas-api-tls") pod "maas-api-e2e-derive-678b1628-58bd89844d-jcz92" (UID: "ee19ff52-f6e8-4ebd-af0c-d8385855d860") : secret "maas-api-e2e-derive-678b1628-serving-cert" not found
Oct 30 22:21:50.299911 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.299126    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee19ff52-f6e8-4ebd-af0c-d8385855d860-openshift-service-ca\") pod \"maas-api-e2e-derive-678b1628-58bd89844d-jcz92\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:50.362643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.362561    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wz2w\" (UniqueName: \"kubernetes.io/projected/ee19ff52-f6e8-4ebd-af0c-d8385855d860-kube-api-access-8wz2w\") pod \"maas-api-e2e-derive-678b1628-58bd89844d-jcz92\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:50.364281 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.364252    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njjqf\" (UniqueName: \"kubernetes.io/projected/9dd33760-037c-41b0-848d-50c297665fd8-kube-api-access-njjqf\") pod \"payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9\" (UID: \"9dd33760-037c-41b0-848d-50c297665fd8\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"
Oct 30 22:21:50.422659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.422164    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:50.452170 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.452137    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"
Oct 30 22:21:50.797687 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.797096    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:50.881981 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:21:50.881944    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-serving-cert: secret "maas-api-e2e-derive-678b1628-serving-cert" not found
Oct 30 22:21:50.882197 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:21:50.882042    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-maas-api-tls podName:ee19ff52-f6e8-4ebd-af0c-d8385855d860 nodeName:}" failed. No retries permitted until 2026-10-30 22:21:51.882015947 +0000 UTC m=+1626.612873072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-maas-api-tls") pod "maas-api-e2e-derive-678b1628-58bd89844d-jcz92" (UID: "ee19ff52-f6e8-4ebd-af0c-d8385855d860") : secret "maas-api-e2e-derive-678b1628-serving-cert" not found
Oct 30 22:21:50.882427 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.882396    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-maas-api-tls\") pod \"maas-api-e2e-derive-678b1628-58bd89844d-jcz92\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:50.931836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:50.931800    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"]
Oct 30 22:21:51.079150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:51.079110    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:51.287308 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:51.287269    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9" event={"ID":"9dd33760-037c-41b0-848d-50c297665fd8","Type":"ContainerStarted","Data":"e25e0859f60178138825f64f53144744a8a702f6b55f3e637e1d5c611bef0f06"}
Oct 30 22:21:51.287754 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:51.287364    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9" event={"ID":"9dd33760-037c-41b0-848d-50c297665fd8","Type":"ContainerStarted","Data":"aaf8866b5a466555b9893dce5b1edcf5fd5b09c089ff4d744f4751684ac95afb"}
Oct 30 22:21:51.287754 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:51.287529    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"
Oct 30 22:21:51.408792 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:51.408688    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9" podStartSLOduration=2.408671944 podStartE2EDuration="2.408671944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:21:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:21:51.403794223 +0000 UTC m=+1626.134651368" watchObservedRunningTime="2026-10-30 22:21:51.408671944 +0000 UTC m=+1626.139529086"
Oct 30 22:21:51.911103 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:51.906244    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-maas-api-tls\") pod \"maas-api-e2e-derive-678b1628-58bd89844d-jcz92\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:51.919571 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:51.919534    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-maas-api-tls\") pod \"maas-api-e2e-derive-678b1628-58bd89844d-jcz92\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:52.057139 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:52.057103    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:52.509221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:52.509140    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"]
Oct 30 22:21:52.520237 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:21:52.520187    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee19ff52_f6e8_4ebd_af0c_d8385855d860.slice/crio-75a472a0dc0ccd84cb17b002393a15c20377eef4ee9c61264db9035e87805d6f WatchSource:0}: Error finding container 75a472a0dc0ccd84cb17b002393a15c20377eef4ee9c61264db9035e87805d6f: Status 404 returned error can't find the container with id 75a472a0dc0ccd84cb17b002393a15c20377eef4ee9c61264db9035e87805d6f
Oct 30 22:21:53.308639 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:53.307212    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92" event={"ID":"ee19ff52-f6e8-4ebd-af0c-d8385855d860","Type":"ContainerStarted","Data":"75a472a0dc0ccd84cb17b002393a15c20377eef4ee9c61264db9035e87805d6f"}
Oct 30 22:21:54.318345 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:54.318305    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92" event={"ID":"ee19ff52-f6e8-4ebd-af0c-d8385855d860","Type":"ContainerStarted","Data":"0c9e7ee09fee860a4dcc54bae35802a5da39117c4551eeb86b20032dc84fb467"}
Oct 30 22:21:54.318892 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:54.318404    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:21:54.439820 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:54.439751    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92" podStartSLOduration=4.667728944 podStartE2EDuration="5.439731407s" totalImagesPullingTime="772.002463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:21:54.437083407 +0000 UTC m=+1629.167940552" watchObservedRunningTime="2026-10-30 22:21:54.439731407 +0000 UTC m=+1629.170588553"
Oct 30 22:21:54.715401 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:54.715311    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:54.980092 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:54.979992    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:55.215205 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:55.215168    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:56.312695 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:56.310355    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:59.452345 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:59.452282    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:59.667530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:21:59.667497    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:00.332268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:00.332237    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:22:01.593107 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:01.593068    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:02.303556 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:02.303525    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"
Oct 30 22:22:05.273644 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:05.267380    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:22:06.757639 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:06.756949    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:11.865315 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:11.865269    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:13.175417 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:22:13.175377    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:22:16.956803 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:16.956766    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:22.085619 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:22.085574    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:24.899598 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:24.899551    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:27.046216 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:27.046180    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:30.058360 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:30.058323    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"]
Oct 30 22:22:30.107761 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:30.107732    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3b04a455-4jqjv"]
Oct 30 22:22:31.382755 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:31.382719    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef4c4ad1-cd14-45fc-a321-56b6794e69af" path="/var/lib/kubelet/pods/ef4c4ad1-cd14-45fc-a321-56b6794e69af/volumes"
Oct 30 22:22:31.773143 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:31.773052    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:37.232824 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:37.232780    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:37.516038 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:37.515944    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:37.739428 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:37.739392    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:43.096616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:43.096556    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:43.177726 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:22:43.177667    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:22:45.800451 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:45.800419    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:46.030720 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:46.030684    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:47.942088 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:47.942050    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"]
Oct 30 22:22:47.946467 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:47.946444    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:48.002470 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.002441    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-367f4491-serving-cert\""
Oct 30 22:22:48.007217 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.007191    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"]
Oct 30 22:22:48.039362 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.039334    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-metrics-certs\") pod \"maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:48.039479 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.039393    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3a9238-cf39-482f-8c63-4f681ca18c4e-openshift-service-ca\") pod \"maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:48.039625 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.039606    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-maas-api-tls\") pod \"maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:48.039682 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.039667    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8tld\" (UniqueName: \"kubernetes.io/projected/bb3a9238-cf39-482f-8c63-4f681ca18c4e-kube-api-access-h8tld\") pod \"maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:48.141738 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.141697    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-metrics-certs\") pod \"maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:48.141932 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.141765    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3a9238-cf39-482f-8c63-4f681ca18c4e-openshift-service-ca\") pod \"maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:48.141932 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.141920    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-maas-api-tls\") pod \"maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:48.142063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.141993    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8tld\" (UniqueName: \"kubernetes.io/projected/bb3a9238-cf39-482f-8c63-4f681ca18c4e-kube-api-access-h8tld\") pod \"maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:48.142122 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:22:48.142068    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-serving-cert: secret "maas-api-e2e-mt-367f4491-serving-cert" not found
Oct 30 22:22:48.142170 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:22:48.142159    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-maas-api-tls podName:bb3a9238-cf39-482f-8c63-4f681ca18c4e nodeName:}" failed. No retries permitted until 2026-10-30 22:22:48.642138097 +0000 UTC m=+1683.372995236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-maas-api-tls") pod "maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb" (UID: "bb3a9238-cf39-482f-8c63-4f681ca18c4e") : secret "maas-api-e2e-mt-367f4491-serving-cert" not found
Oct 30 22:22:48.142485 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.142464    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3a9238-cf39-482f-8c63-4f681ca18c4e-openshift-service-ca\") pod \"maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:48.144151 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.144132    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-metrics-certs\") pod \"maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:48.205073 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.205003    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8tld\" (UniqueName: \"kubernetes.io/projected/bb3a9238-cf39-482f-8c63-4f681ca18c4e-kube-api-access-h8tld\") pod \"maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:48.211723 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.211649    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:48.431640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.431566    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:48.664909 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.664864    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-maas-api-tls\") pod \"maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:48.671406 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.671376    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-maas-api-tls\") pod \"maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:48.696005 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.695969    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:48.862903 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:48.862870    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:49.253339 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:22:49.253307    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb3a9238_cf39_482f_8c63_4f681ca18c4e.slice/crio-5b5ef739cec4d741b91f02808a22785ce56c06a7e202960673c0e726518fa2b4 WatchSource:0}: Error finding container 5b5ef739cec4d741b91f02808a22785ce56c06a7e202960673c0e726518fa2b4: Status 404 returned error can't find the container with id 5b5ef739cec4d741b91f02808a22785ce56c06a7e202960673c0e726518fa2b4
Oct 30 22:22:49.258804 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:49.258773    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"]
Oct 30 22:22:49.888444 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:49.888394    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb" event={"ID":"bb3a9238-cf39-482f-8c63-4f681ca18c4e","Type":"ContainerStarted","Data":"5b5ef739cec4d741b91f02808a22785ce56c06a7e202960673c0e726518fa2b4"}
Oct 30 22:22:50.779149 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:50.779112    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:50.904382 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:50.904345    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb" event={"ID":"bb3a9238-cf39-482f-8c63-4f681ca18c4e","Type":"ContainerStarted","Data":"1a81d80e0d0868d33f320f7dd6184655c35ab920ab24d170a26ca4ef1419748a"}
Oct 30 22:22:50.904579 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:50.904430    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:51.059856 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:51.059794    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb" podStartSLOduration=3.254788772 podStartE2EDuration="4.059778294s" totalImagesPullingTime="804.989522ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:22:51.059049938 +0000 UTC m=+1685.789907100" watchObservedRunningTime="2026-10-30 22:22:51.059778294 +0000 UTC m=+1685.790635440"
Oct 30 22:22:52.139383 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:52.139343    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:52.413668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:52.413542    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:53.591613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:53.591379    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:55.992329 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:55.992289    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:56.255394 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:56.255303    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:56.917737 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:56.917709    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:22:59.262111 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.262078    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"]
Oct 30 22:22:59.266868 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.266850    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:22:59.354819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.354741    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:22:59.354971 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.354854    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkzk4\" (UniqueName: \"kubernetes.io/projected/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-kube-api-access-mkzk4\") pod \"maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:22:59.355014 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.354978    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:22:59.355153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.355135    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:22:59.371324 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.371299    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-2dd57a-serving-cert\""
Oct 30 22:22:59.387137 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.387106    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"]
Oct 30 22:22:59.457206 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.457169    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:22:59.457574 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.457545    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:22:59.457836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.457817    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:22:59.457912 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.457863    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkzk4\" (UniqueName: \"kubernetes.io/projected/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-kube-api-access-mkzk4\") pod \"maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:22:59.458372 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:22:59.457229    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-serving-cert: secret "maas-api-e2e-shared-a-w2-2dd57a-serving-cert" not found
Oct 30 22:22:59.458462 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:22:59.458427    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-maas-api-tls podName:e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b nodeName:}" failed. No retries permitted until 2026-10-30 22:22:59.958405772 +0000 UTC m=+1694.689262908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-maas-api-tls") pod "maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz" (UID: "e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b") : secret "maas-api-e2e-shared-a-w2-2dd57a-serving-cert" not found
Oct 30 22:22:59.460040 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.460011    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:22:59.468703 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.468674    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:22:59.550701 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.550633    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkzk4\" (UniqueName: \"kubernetes.io/projected/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-kube-api-access-mkzk4\") pod \"maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:22:59.590159 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.590128    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:59.861938 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.861897    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:59.970702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.970664    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:22:59.993898 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:22:59.988913    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:23:00.094626 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:00.094576    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:00.181063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:00.180976    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:23:00.952652 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:00.952622    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"]
Oct 30 22:23:00.954202 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:23:00.954170    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7158d24_dbaa_46f4_a2a0_0a2ea1411f2b.slice/crio-a8b8e1fc92b254ff203ccd32cdc5ca1309e43787d6b9d08f49975c4a976be4ba WatchSource:0}: Error finding container a8b8e1fc92b254ff203ccd32cdc5ca1309e43787d6b9d08f49975c4a976be4ba: Status 404 returned error can't find the container with id a8b8e1fc92b254ff203ccd32cdc5ca1309e43787d6b9d08f49975c4a976be4ba
Oct 30 22:23:01.014826 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:01.014786    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz" event={"ID":"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b","Type":"ContainerStarted","Data":"a8b8e1fc92b254ff203ccd32cdc5ca1309e43787d6b9d08f49975c4a976be4ba"}
Oct 30 22:23:02.025159 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:02.025064    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz" event={"ID":"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b","Type":"ContainerStarted","Data":"426e88953c7583475107fc744f3a68f1486e44d0e27608a98f51f03d0fb00eec"}
Oct 30 22:23:02.025537 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:02.025172    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:23:02.147222 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:02.147165    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz" podStartSLOduration=2.351179736 podStartE2EDuration="3.147149929s" totalImagesPullingTime="795.970193ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:23:02.143348506 +0000 UTC m=+1696.874205673" watchObservedRunningTime="2026-10-30 22:23:02.147149929 +0000 UTC m=+1696.878007086"
Oct 30 22:23:05.497947 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:05.497906    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:06.491326 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:06.491285    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"]
Oct 30 22:23:06.491648 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:06.491573    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls" podUID="6b2ea3e6-d869-4d74-999b-be8d970d1c17" containerName="istio-proxy" containerID="cri-o://7ce256fe000f6846df955879bb065d8635721ad8266727435e60fb63f71831a0" gracePeriod=30
Oct 30 22:23:06.544615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:06.541372    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"]
Oct 30 22:23:06.544615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:06.541585    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8" podUID="3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" containerName="istio-proxy" containerID="cri-o://a8dfecb0a8328dece314d98ef443333d3fc14995ae9d697f5a42143ae315639c" gracePeriod=30
Oct 30 22:23:06.549709 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:06.549676    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"]
Oct 30 22:23:06.549990 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:06.549917    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4" podUID="89c01284-2e3c-4637-93ad-b3d27024a745" containerName="istio-proxy" containerID="cri-o://82278aa32afda5eefb72ae90384eac1df8f3743163492636875c7a5e99b311cc" gracePeriod=30
Oct 30 22:23:08.062680 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:08.062652    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:23:09.780894 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:09.780859    5258 patch_prober.go:29] interesting pod/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:23:09.781298 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:09.780936    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls" podUID="6b2ea3e6-d869-4d74-999b-be8d970d1c17" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:23:11.022723 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.022690    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:11.866177 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.866152    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:23:11.926818 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.926778    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:23:11.964525 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.964499    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:23:11.971608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.971573    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-workload-certs\") pod \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") "
Oct 30 22:23:11.971747 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.971732    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-podinfo\") pod \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") "
Oct 30 22:23:11.971816 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.971790    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istiod-ca-cert\") pod \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") "
Oct 30 22:23:11.971879 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.971833    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-workload-certs" pod "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" (UID: "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:11.971934 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.971915    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-envoy\") pod \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") "
Oct 30 22:23:11.972042 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.972029    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-kube-api-access-smfpf\" (UniqueName: \"kubernetes.io/projected/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-kube-api-access-smfpf\") pod \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") "
Oct 30 22:23:11.972115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.972067    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-workload-socket\") pod \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") "
Oct 30 22:23:11.972115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.972112    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-token\" (UniqueName: \"kubernetes.io/projected/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-token\") pod \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") "
Oct 30 22:23:11.972238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.972125    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istiod-ca-cert" pod "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" (UID: "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:11.972238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.972172    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-data\") pod \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") "
Oct 30 22:23:11.972238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.972226    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-credential-socket\") pod \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\" (UID: \"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa\") "
Oct 30 22:23:11.972387 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.972347    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-workload-socket" pod "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" (UID: "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:11.972672 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.972650    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-data" pod "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" (UID: "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:11.972789 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.972671    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-credential-socket" pod "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" (UID: "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:11.973180 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.973156    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:11.973250 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.973184    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:11.973250 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.973200    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:11.973250 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.973215    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:11.973250 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.973229    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:11.974167 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.974147    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-envoy" pod "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" (UID: "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:11.974370 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.974346    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-podinfo" pod "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" (UID: "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:23:11.974453 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.974363    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-kube-api-access-smfpf" pod "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" (UID: "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa"). InnerVolumeSpecName "kube-api-access-smfpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:11.975092 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:11.975071    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-token" pod "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" (UID: "3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:12.074222 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.074193    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-istio-data\") pod \"89c01284-2e3c-4637-93ad-b3d27024a745\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") "
Oct 30 22:23:12.074732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.074236    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-workload-socket\") pod \"89c01284-2e3c-4637-93ad-b3d27024a745\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") "
Oct 30 22:23:12.074732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.074270    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-credential-socket\") pod \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") "
Oct 30 22:23:12.074732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.074307    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/89c01284-2e3c-4637-93ad-b3d27024a745-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89c01284-2e3c-4637-93ad-b3d27024a745-istiod-ca-cert\") pod \"89c01284-2e3c-4637-93ad-b3d27024a745\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") "
Oct 30 22:23:12.074732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.074335    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-credential-socket\") pod \"89c01284-2e3c-4637-93ad-b3d27024a745\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") "
Oct 30 22:23:12.074732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.074409    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-workload-socket\") pod \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") "
Oct 30 22:23:12.074732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.074514    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-workload-certs\") pod \"89c01284-2e3c-4637-93ad-b3d27024a745\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") "
Oct 30 22:23:12.074732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.074554    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istiod-ca-cert\") pod \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") "
Oct 30 22:23:12.074732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.074566    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-credential-socket" pod "6b2ea3e6-d869-4d74-999b-be8d970d1c17" (UID: "6b2ea3e6-d869-4d74-999b-be8d970d1c17"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:12.074732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.074664    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-workload-certs\") pod \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") "
Oct 30 22:23:12.074732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.074707    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b2ea3e6-d869-4d74-999b-be8d970d1c17-kube-api-access-k2sbp\" (UniqueName: \"kubernetes.io/projected/6b2ea3e6-d869-4d74-999b-be8d970d1c17-kube-api-access-k2sbp\") pod \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") "
Oct 30 22:23:12.075248 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.074823    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-workload-socket" pod "89c01284-2e3c-4637-93ad-b3d27024a745" (UID: "89c01284-2e3c-4637-93ad-b3d27024a745"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:12.075248 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.074836    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-workload-socket" pod "6b2ea3e6-d869-4d74-999b-be8d970d1c17" (UID: "6b2ea3e6-d869-4d74-999b-be8d970d1c17"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:12.075248 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.075198    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-workload-certs" pod "6b2ea3e6-d869-4d74-999b-be8d970d1c17" (UID: "6b2ea3e6-d869-4d74-999b-be8d970d1c17"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:12.075398 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.075383    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-envoy\") pod \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") "
Oct 30 22:23:12.075455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.075428    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-token\" (UniqueName: \"kubernetes.io/projected/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-token\") pod \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") "
Oct 30 22:23:12.075514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.075481    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-data\") pod \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") "
Oct 30 22:23:12.075576 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.075522    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istiod-ca-cert" pod "6b2ea3e6-d869-4d74-999b-be8d970d1c17" (UID: "6b2ea3e6-d869-4d74-999b-be8d970d1c17"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:12.075576 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.075567    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/89c01284-2e3c-4637-93ad-b3d27024a745-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89c01284-2e3c-4637-93ad-b3d27024a745-istio-podinfo\") pod \"89c01284-2e3c-4637-93ad-b3d27024a745\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") "
Oct 30 22:23:12.075710 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.075660    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89c01284-2e3c-4637-93ad-b3d27024a745-kube-api-access-664ln\" (UniqueName: \"kubernetes.io/projected/89c01284-2e3c-4637-93ad-b3d27024a745-kube-api-access-664ln\") pod \"89c01284-2e3c-4637-93ad-b3d27024a745\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") "
Oct 30 22:23:12.075710 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.075693    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89c01284-2e3c-4637-93ad-b3d27024a745-istio-token\" (UniqueName: \"kubernetes.io/projected/89c01284-2e3c-4637-93ad-b3d27024a745-istio-token\") pod \"89c01284-2e3c-4637-93ad-b3d27024a745\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") "
Oct 30 22:23:12.075798 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.075721    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-istio-envoy\") pod \"89c01284-2e3c-4637-93ad-b3d27024a745\" (UID: \"89c01284-2e3c-4637-93ad-b3d27024a745\") "
Oct 30 22:23:12.075798 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.075771    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-podinfo\") pod \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\" (UID: \"6b2ea3e6-d869-4d74-999b-be8d970d1c17\") "
Oct 30 22:23:12.078015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.076861    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.078015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.076893    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.078015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.076908    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.078015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.076923    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.078015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.076936    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.078015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.076951    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.078015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.076965    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.078015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.076980    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smfpf\" (UniqueName: \"kubernetes.io/projected/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-kube-api-access-smfpf\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.078015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.076994    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.078804 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.078215    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-envoy" pod "6b2ea3e6-d869-4d74-999b-be8d970d1c17" (UID: "6b2ea3e6-d869-4d74-999b-be8d970d1c17"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:12.078804 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.078331    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b2ea3e6-d869-4d74-999b-be8d970d1c17-kube-api-access-k2sbp" pod "6b2ea3e6-d869-4d74-999b-be8d970d1c17" (UID: "6b2ea3e6-d869-4d74-999b-be8d970d1c17"). InnerVolumeSpecName "kube-api-access-k2sbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:12.078804 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.078507    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-data" pod "6b2ea3e6-d869-4d74-999b-be8d970d1c17" (UID: "6b2ea3e6-d869-4d74-999b-be8d970d1c17"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:12.079561 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.079225    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-istio-data" pod "89c01284-2e3c-4637-93ad-b3d27024a745" (UID: "89c01284-2e3c-4637-93ad-b3d27024a745"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:12.079677 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.079602    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-workload-certs" pod "89c01284-2e3c-4637-93ad-b3d27024a745" (UID: "89c01284-2e3c-4637-93ad-b3d27024a745"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:12.080980 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.080951    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-credential-socket" pod "89c01284-2e3c-4637-93ad-b3d27024a745" (UID: "89c01284-2e3c-4637-93ad-b3d27024a745"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:12.081479 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.081451    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89c01284-2e3c-4637-93ad-b3d27024a745-istiod-ca-cert" pod "89c01284-2e3c-4637-93ad-b3d27024a745" (UID: "89c01284-2e3c-4637-93ad-b3d27024a745"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:12.083416 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.083393    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-istio-envoy" pod "89c01284-2e3c-4637-93ad-b3d27024a745" (UID: "89c01284-2e3c-4637-93ad-b3d27024a745"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:12.083505 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.083410    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89c01284-2e3c-4637-93ad-b3d27024a745-istio-podinfo" pod "89c01284-2e3c-4637-93ad-b3d27024a745" (UID: "89c01284-2e3c-4637-93ad-b3d27024a745"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:23:12.083505 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.083432    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-podinfo" pod "6b2ea3e6-d869-4d74-999b-be8d970d1c17" (UID: "6b2ea3e6-d869-4d74-999b-be8d970d1c17"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:23:12.083505 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.083489    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-token" pod "6b2ea3e6-d869-4d74-999b-be8d970d1c17" (UID: "6b2ea3e6-d869-4d74-999b-be8d970d1c17"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:12.083866 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.083776    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89c01284-2e3c-4637-93ad-b3d27024a745-kube-api-access-664ln" pod "89c01284-2e3c-4637-93ad-b3d27024a745" (UID: "89c01284-2e3c-4637-93ad-b3d27024a745"). InnerVolumeSpecName "kube-api-access-664ln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:12.084815 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.084794    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89c01284-2e3c-4637-93ad-b3d27024a745-istio-token" pod "89c01284-2e3c-4637-93ad-b3d27024a745" (UID: "89c01284-2e3c-4637-93ad-b3d27024a745"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:12.143868 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.143840    5258 generic.go:356] "Generic (PLEG): container finished" podID="6b2ea3e6-d869-4d74-999b-be8d970d1c17" containerID="7ce256fe000f6846df955879bb065d8635721ad8266727435e60fb63f71831a0" exitCode=0
Oct 30 22:23:12.144023 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.143893    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"
Oct 30 22:23:12.144023 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.143922    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls" event={"ID":"6b2ea3e6-d869-4d74-999b-be8d970d1c17","Type":"ContainerDied","Data":"7ce256fe000f6846df955879bb065d8635721ad8266727435e60fb63f71831a0"}
Oct 30 22:23:12.144023 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.143981    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls" event={"ID":"6b2ea3e6-d869-4d74-999b-be8d970d1c17","Type":"ContainerDied","Data":"f9ef0cc4dc944e7fd9cf78f7718fc46d4558941eb08fc7de24947ce526f9fa37"}
Oct 30 22:23:12.144023 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.144014    5258 scope.go:122] "RemoveContainer" containerID="7ce256fe000f6846df955879bb065d8635721ad8266727435e60fb63f71831a0"
Oct 30 22:23:12.145746 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.145718    5258 generic.go:356] "Generic (PLEG): container finished" podID="89c01284-2e3c-4637-93ad-b3d27024a745" containerID="82278aa32afda5eefb72ae90384eac1df8f3743163492636875c7a5e99b311cc" exitCode=0
Oct 30 22:23:12.145861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.145757    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"
Oct 30 22:23:12.145861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.145766    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4" event={"ID":"89c01284-2e3c-4637-93ad-b3d27024a745","Type":"ContainerDied","Data":"82278aa32afda5eefb72ae90384eac1df8f3743163492636875c7a5e99b311cc"}
Oct 30 22:23:12.145861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.145814    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4" event={"ID":"89c01284-2e3c-4637-93ad-b3d27024a745","Type":"ContainerDied","Data":"ad6df1e9de52cf3620d721acac9d39dcd4fb0c65961ad4bc5294979d618bd061"}
Oct 30 22:23:12.147570 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.147549    5258 generic.go:356] "Generic (PLEG): container finished" podID="3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" containerID="a8dfecb0a8328dece314d98ef443333d3fc14995ae9d697f5a42143ae315639c" exitCode=0
Oct 30 22:23:12.147692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.147625    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8" event={"ID":"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa","Type":"ContainerDied","Data":"a8dfecb0a8328dece314d98ef443333d3fc14995ae9d697f5a42143ae315639c"}
Oct 30 22:23:12.147692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.147677    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8" event={"ID":"3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa","Type":"ContainerDied","Data":"7e492ffacd8db07de545e8dadcb747e6777fdcd8ff3ebdcb174355e39ac6948c"}
Oct 30 22:23:12.147789 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.147636    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"
Oct 30 22:23:12.158299 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.158281    5258 scope.go:122] "RemoveContainer" containerID="7ce256fe000f6846df955879bb065d8635721ad8266727435e60fb63f71831a0"
Oct 30 22:23:12.158539 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:23:12.158519    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ce256fe000f6846df955879bb065d8635721ad8266727435e60fb63f71831a0\": container with ID starting with 7ce256fe000f6846df955879bb065d8635721ad8266727435e60fb63f71831a0 not found: ID does not exist" containerID="7ce256fe000f6846df955879bb065d8635721ad8266727435e60fb63f71831a0"
Oct 30 22:23:12.158697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.158543    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ce256fe000f6846df955879bb065d8635721ad8266727435e60fb63f71831a0"} err="failed to get container status \"7ce256fe000f6846df955879bb065d8635721ad8266727435e60fb63f71831a0\": rpc error: code = NotFound desc = could not find container \"7ce256fe000f6846df955879bb065d8635721ad8266727435e60fb63f71831a0\": container with ID starting with 7ce256fe000f6846df955879bb065d8635721ad8266727435e60fb63f71831a0 not found: ID does not exist"
Oct 30 22:23:12.158697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.158561    5258 scope.go:122] "RemoveContainer" containerID="82278aa32afda5eefb72ae90384eac1df8f3743163492636875c7a5e99b311cc"
Oct 30 22:23:12.171782 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.171760    5258 scope.go:122] "RemoveContainer" containerID="82278aa32afda5eefb72ae90384eac1df8f3743163492636875c7a5e99b311cc"
Oct 30 22:23:12.179914 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:23:12.179891    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82278aa32afda5eefb72ae90384eac1df8f3743163492636875c7a5e99b311cc\": container with ID starting with 82278aa32afda5eefb72ae90384eac1df8f3743163492636875c7a5e99b311cc not found: ID does not exist" containerID="82278aa32afda5eefb72ae90384eac1df8f3743163492636875c7a5e99b311cc"
Oct 30 22:23:12.180049 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.179919    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82278aa32afda5eefb72ae90384eac1df8f3743163492636875c7a5e99b311cc"} err="failed to get container status \"82278aa32afda5eefb72ae90384eac1df8f3743163492636875c7a5e99b311cc\": rpc error: code = NotFound desc = could not find container \"82278aa32afda5eefb72ae90384eac1df8f3743163492636875c7a5e99b311cc\": container with ID starting with 82278aa32afda5eefb72ae90384eac1df8f3743163492636875c7a5e99b311cc not found: ID does not exist"
Oct 30 22:23:12.180049 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.179939    5258 scope.go:122] "RemoveContainer" containerID="a8dfecb0a8328dece314d98ef443333d3fc14995ae9d697f5a42143ae315639c"
Oct 30 22:23:12.180189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.180097    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.180189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.180115    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.180189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.180125    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89c01284-2e3c-4637-93ad-b3d27024a745-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.180189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.180134    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.180189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.180145    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.180189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.180160    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2sbp\" (UniqueName: \"kubernetes.io/projected/6b2ea3e6-d869-4d74-999b-be8d970d1c17-kube-api-access-k2sbp\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.180189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.180169    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.180189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.180177    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.180189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.180184    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b2ea3e6-d869-4d74-999b-be8d970d1c17-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.180189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.180193    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89c01284-2e3c-4637-93ad-b3d27024a745-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.180631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.180202    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-664ln\" (UniqueName: \"kubernetes.io/projected/89c01284-2e3c-4637-93ad-b3d27024a745-kube-api-access-664ln\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.180631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.180211    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89c01284-2e3c-4637-93ad-b3d27024a745-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.180631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.180221    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89c01284-2e3c-4637-93ad-b3d27024a745-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:12.195289 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.195266    5258 scope.go:122] "RemoveContainer" containerID="a8dfecb0a8328dece314d98ef443333d3fc14995ae9d697f5a42143ae315639c"
Oct 30 22:23:12.195745 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:23:12.195689    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8dfecb0a8328dece314d98ef443333d3fc14995ae9d697f5a42143ae315639c\": container with ID starting with a8dfecb0a8328dece314d98ef443333d3fc14995ae9d697f5a42143ae315639c not found: ID does not exist" containerID="a8dfecb0a8328dece314d98ef443333d3fc14995ae9d697f5a42143ae315639c"
Oct 30 22:23:12.195919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.195739    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8dfecb0a8328dece314d98ef443333d3fc14995ae9d697f5a42143ae315639c"} err="failed to get container status \"a8dfecb0a8328dece314d98ef443333d3fc14995ae9d697f5a42143ae315639c\": rpc error: code = NotFound desc = could not find container \"a8dfecb0a8328dece314d98ef443333d3fc14995ae9d697f5a42143ae315639c\": container with ID starting with a8dfecb0a8328dece314d98ef443333d3fc14995ae9d697f5a42143ae315639c not found: ID does not exist"
Oct 30 22:23:12.413468 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.413357    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"]
Oct 30 22:23:12.418000 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.417976    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jcmls"]
Oct 30 22:23:12.522221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.522190    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"]
Oct 30 22:23:12.529434 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.529409    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-b5kl8"]
Oct 30 22:23:12.656629 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.656544    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"]
Oct 30 22:23:12.657897 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:12.657865    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-2a4123-openshift-default-554c56cc99-jxkr4"]
Oct 30 22:23:13.164241 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:23:13.164205    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:23:13.389804 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:13.389767    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" path="/var/lib/kubelet/pods/3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa/volumes"
Oct 30 22:23:13.390646 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:13.390626    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b2ea3e6-d869-4d74-999b-be8d970d1c17" path="/var/lib/kubelet/pods/6b2ea3e6-d869-4d74-999b-be8d970d1c17/volumes"
Oct 30 22:23:13.391358 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:13.391340    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="89c01284-2e3c-4637-93ad-b3d27024a745" path="/var/lib/kubelet/pods/89c01284-2e3c-4637-93ad-b3d27024a745/volumes"
Oct 30 22:23:14.877139 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:14.877099    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:16.315156 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:16.315121    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:16.546883 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:16.546792    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:16.764686 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:16.764185    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:21.368787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:21.368741    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:21.982712 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:21.982679    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:25.248298 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:25.248261    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:25.462787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:25.462746    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:26.400335 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:26.400109    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:27.048693 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:27.048659    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:28.944698 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:28.944660    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:23:31.788102 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:31.785322    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:36.483239 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:36.483212    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:38.268692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:38.268653    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:38.414282 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:38.414247    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"]
Oct 30 22:23:38.414526 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:38.414502    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt" podUID="19b956fb-6a5f-4e18-800b-a94cb43dba93" containerName="istio-proxy" containerID="cri-o://559816cab64014f586615c483d40fc4f5d159f881ad7498533f17ce35bd2c604" gracePeriod=30
Oct 30 22:23:38.494566 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:38.494496    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:38.720253 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:38.720213    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:38.942015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:38.941959    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:39.754715 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:39.754675    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:40.831021 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:40.830983    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"]
Oct 30 22:23:40.831796 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:40.831777    5258 cpu_manager.go:414] "containerMap: removing container" podUID="89c01284-2e3c-4637-93ad-b3d27024a745" containerName="istio-proxy"
Oct 30 22:23:40.831875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:40.831798    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="89c01284-2e3c-4637-93ad-b3d27024a745" containerName="istio-proxy"
Oct 30 22:23:40.831875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:40.831817    5258 cpu_manager.go:414] "containerMap: removing container" podUID="6b2ea3e6-d869-4d74-999b-be8d970d1c17" containerName="istio-proxy"
Oct 30 22:23:40.831875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:40.831821    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b2ea3e6-d869-4d74-999b-be8d970d1c17" containerName="istio-proxy"
Oct 30 22:23:40.831875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:40.831849    5258 cpu_manager.go:414] "containerMap: removing container" podUID="3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" containerName="istio-proxy"
Oct 30 22:23:40.831875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:40.831855    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" containerName="istio-proxy"
Oct 30 22:23:40.832031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:40.831990    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b0a6cea-4ba3-46d5-a185-e2d90d4df6fa" containerName="istio-proxy"
Oct 30 22:23:40.832031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:40.832007    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="89c01284-2e3c-4637-93ad-b3d27024a745" containerName="istio-proxy"
Oct 30 22:23:40.832031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:40.832016    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b2ea3e6-d869-4d74-999b-be8d970d1c17" containerName="istio-proxy"
Oct 30 22:23:40.909280 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:40.909242    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:40.939540 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:40.939513    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"]
Oct 30 22:23:41.000234 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.000001    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:41.019639 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.016790    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w0-8e1227-openshift-default-dockercfg-g7ggf\""
Oct 30 22:23:41.107953 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.107857    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc948e1-3516-469d-a39f-8531663ea68c-istiod-ca-cert\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.107953 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.107921    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-istio-data\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.108206 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.108093    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-workload-socket\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.108206 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.108143    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s4ww\" (UniqueName: \"kubernetes.io/projected/bdc948e1-3516-469d-a39f-8531663ea68c-kube-api-access-6s4ww\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.108206 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.108176    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-istio-envoy\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.108376 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.108262    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-credential-socket\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.108376 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.108357    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdc948e1-3516-469d-a39f-8531663ea68c-istio-token\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.108780 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.108701    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-workload-certs\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.108780 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.108736    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc948e1-3516-469d-a39f-8531663ea68c-istio-podinfo\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.210668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.210631    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdc948e1-3516-469d-a39f-8531663ea68c-istio-token\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.210870 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.210818    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-workload-certs\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.210870 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.210853    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc948e1-3516-469d-a39f-8531663ea68c-istio-podinfo\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.210999 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.210935    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc948e1-3516-469d-a39f-8531663ea68c-istiod-ca-cert\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.211053 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.211010    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-istio-data\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.211107 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.211092    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-workload-socket\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.211163 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.211130    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4ww\" (UniqueName: \"kubernetes.io/projected/bdc948e1-3516-469d-a39f-8531663ea68c-kube-api-access-6s4ww\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.211216 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.211161    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-istio-envoy\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.211300 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.211259    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-workload-certs\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.211300 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.211261    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-credential-socket\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.211864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.211840    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-credential-socket\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.211976 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.211958    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-workload-socket\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.212103 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.212078    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-istio-data\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.212152 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.212105    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc948e1-3516-469d-a39f-8531663ea68c-istiod-ca-cert\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.213513 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.213493    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc948e1-3516-469d-a39f-8531663ea68c-istio-podinfo\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.213773 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.213750    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-istio-envoy\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.274319 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.274283    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdc948e1-3516-469d-a39f-8531663ea68c-istio-token\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.274929 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.274904    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s4ww\" (UniqueName: \"kubernetes.io/projected/bdc948e1-3516-469d-a39f-8531663ea68c-kube-api-access-6s4ww\") pod \"e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") " pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.313984 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.313952    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:41.468303 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.468235    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:41.968401 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:23:41.968367    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc948e1_3516_469d_a39f_8531663ea68c.slice/crio-0d0f159cdff8bc6856f9079b4448ac19e9f3f8b023caa97e2ad489916f1a36b0 WatchSource:0}: Error finding container 0d0f159cdff8bc6856f9079b4448ac19e9f3f8b023caa97e2ad489916f1a36b0: Status 404 returned error can't find the container with id 0d0f159cdff8bc6856f9079b4448ac19e9f3f8b023caa97e2ad489916f1a36b0
Oct 30 22:23:41.968905 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.968884    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"]
Oct 30 22:23:41.971887 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.971847    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:23:41.971973 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.971920    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:23:41.971973 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:41.971952    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:23:42.693002 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:42.692664    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc" event={"ID":"bdc948e1-3516-469d-a39f-8531663ea68c","Type":"ContainerStarted","Data":"d5eeb1f867c442973dd217d6460bd719fe0c95e91bb68926db53046b60ee7fac"}
Oct 30 22:23:42.693199 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:42.693035    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc" event={"ID":"bdc948e1-3516-469d-a39f-8531663ea68c","Type":"ContainerStarted","Data":"0d0f159cdff8bc6856f9079b4448ac19e9f3f8b023caa97e2ad489916f1a36b0"}
Oct 30 22:23:42.918385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:42.918318    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc" podStartSLOduration=2.918302751 podStartE2EDuration="2.918302751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:23:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:23:42.865722882 +0000 UTC m=+1737.596580028" watchObservedRunningTime="2026-10-30 22:23:42.918302751 +0000 UTC m=+1737.649159893"
Oct 30 22:23:43.254781 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:23:43.249715    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:23:43.315170 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.315015    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:43.336812 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.336747    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:43.704795 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.704766    5258 generic.go:356] "Generic (PLEG): container finished" podID="19b956fb-6a5f-4e18-800b-a94cb43dba93" containerID="559816cab64014f586615c483d40fc4f5d159f881ad7498533f17ce35bd2c604" exitCode=0
Oct 30 22:23:43.704955 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.704840    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt" event={"ID":"19b956fb-6a5f-4e18-800b-a94cb43dba93","Type":"ContainerDied","Data":"559816cab64014f586615c483d40fc4f5d159f881ad7498533f17ce35bd2c604"}
Oct 30 22:23:43.705174 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.705146    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:43.706347 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.706329    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:23:43.749929 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.749902    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:23:43.879193 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.879159    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-credential-socket\") pod \"19b956fb-6a5f-4e18-800b-a94cb43dba93\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") "
Oct 30 22:23:43.879454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.879208    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/19b956fb-6a5f-4e18-800b-a94cb43dba93-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b956fb-6a5f-4e18-800b-a94cb43dba93-istiod-ca-cert\") pod \"19b956fb-6a5f-4e18-800b-a94cb43dba93\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") "
Oct 30 22:23:43.879454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.879267    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19b956fb-6a5f-4e18-800b-a94cb43dba93-kube-api-access-6x6cj\" (UniqueName: \"kubernetes.io/projected/19b956fb-6a5f-4e18-800b-a94cb43dba93-kube-api-access-6x6cj\") pod \"19b956fb-6a5f-4e18-800b-a94cb43dba93\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") "
Oct 30 22:23:43.879454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.879288    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-podinfo\") pod \"19b956fb-6a5f-4e18-800b-a94cb43dba93\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") "
Oct 30 22:23:43.879454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.879342    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-data\") pod \"19b956fb-6a5f-4e18-800b-a94cb43dba93\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") "
Oct 30 22:23:43.879454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.879414    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-workload-certs\") pod \"19b956fb-6a5f-4e18-800b-a94cb43dba93\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") "
Oct 30 22:23:43.879864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.879481    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-token\" (UniqueName: \"kubernetes.io/projected/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-token\") pod \"19b956fb-6a5f-4e18-800b-a94cb43dba93\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") "
Oct 30 22:23:43.879864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.879551    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-workload-socket\") pod \"19b956fb-6a5f-4e18-800b-a94cb43dba93\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") "
Oct 30 22:23:43.879864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.879682    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-envoy\") pod \"19b956fb-6a5f-4e18-800b-a94cb43dba93\" (UID: \"19b956fb-6a5f-4e18-800b-a94cb43dba93\") "
Oct 30 22:23:43.880027 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.879990    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-workload-certs" pod "19b956fb-6a5f-4e18-800b-a94cb43dba93" (UID: "19b956fb-6a5f-4e18-800b-a94cb43dba93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:43.880376 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.880341    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-workload-socket" pod "19b956fb-6a5f-4e18-800b-a94cb43dba93" (UID: "19b956fb-6a5f-4e18-800b-a94cb43dba93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:43.880542 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.880376    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-credential-socket" pod "19b956fb-6a5f-4e18-800b-a94cb43dba93" (UID: "19b956fb-6a5f-4e18-800b-a94cb43dba93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:43.880626 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.880558    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-data" pod "19b956fb-6a5f-4e18-800b-a94cb43dba93" (UID: "19b956fb-6a5f-4e18-800b-a94cb43dba93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:43.880771 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.880751    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:43.880841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.880775    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:43.880841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.880790    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:43.880841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.880803    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:43.881744 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.881701    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19b956fb-6a5f-4e18-800b-a94cb43dba93-istiod-ca-cert" pod "19b956fb-6a5f-4e18-800b-a94cb43dba93" (UID: "19b956fb-6a5f-4e18-800b-a94cb43dba93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:43.887859 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.887805    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-token" pod "19b956fb-6a5f-4e18-800b-a94cb43dba93" (UID: "19b956fb-6a5f-4e18-800b-a94cb43dba93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:43.887967 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.887921    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b956fb-6a5f-4e18-800b-a94cb43dba93-kube-api-access-6x6cj" pod "19b956fb-6a5f-4e18-800b-a94cb43dba93" (UID: "19b956fb-6a5f-4e18-800b-a94cb43dba93"). InnerVolumeSpecName "kube-api-access-6x6cj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:43.888037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.887995    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-envoy" pod "19b956fb-6a5f-4e18-800b-a94cb43dba93" (UID: "19b956fb-6a5f-4e18-800b-a94cb43dba93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:43.888990 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.888964    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-podinfo" pod "19b956fb-6a5f-4e18-800b-a94cb43dba93" (UID: "19b956fb-6a5f-4e18-800b-a94cb43dba93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:23:43.986488 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.984056    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:43.986488 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.984096    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:43.986488 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.984111    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19b956fb-6a5f-4e18-800b-a94cb43dba93-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:43.986488 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.984127    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x6cj\" (UniqueName: \"kubernetes.io/projected/19b956fb-6a5f-4e18-800b-a94cb43dba93-kube-api-access-6x6cj\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:43.986488 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:43.984143    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19b956fb-6a5f-4e18-800b-a94cb43dba93-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:44.099149 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:44.098861    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:44.717061 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:44.717025    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"
Oct 30 22:23:44.717061 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:44.717039    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt" event={"ID":"19b956fb-6a5f-4e18-800b-a94cb43dba93","Type":"ContainerDied","Data":"276abb073fabbcf79ab73480cfda4e393d3077fe12e31411771aa0da7f3cdf7b"}
Oct 30 22:23:44.717789 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:44.717105    5258 scope.go:122] "RemoveContainer" containerID="559816cab64014f586615c483d40fc4f5d159f881ad7498533f17ce35bd2c604"
Oct 30 22:23:44.886005 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:44.885968    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"]
Oct 30 22:23:44.935040 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:44.935005    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-rvhtt"]
Oct 30 22:23:45.248739 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:45.248705    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:23:45.248897 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:45.248769    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh" podUID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:23:45.383855 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:45.383825    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="19b956fb-6a5f-4e18-800b-a94cb43dba93" path="/var/lib/kubelet/pods/19b956fb-6a5f-4e18-800b-a94cb43dba93/volumes"
Oct 30 22:23:45.785169 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:45.785141    5258 scope.go:122] "RemoveContainer" containerID="e86f19c512298b30faababc7b8fc9b1113f29908b94098404440f3098b60ad4b"
Oct 30 22:23:46.095672 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:46.095631    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:46.322354 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:46.322315    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:47.745658 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:47.745583    5258 generic.go:356] "Generic (PLEG): container finished" podID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerID="ea7f4b5f439ecf9225daa03d384abfde1247ed3911d13b81aff2b8780f2aa3a6" exitCode=0
Oct 30 22:23:47.745658 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:47.745638    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh" event={"ID":"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78","Type":"ContainerDied","Data":"ea7f4b5f439ecf9225daa03d384abfde1247ed3911d13b81aff2b8780f2aa3a6"}
Oct 30 22:23:47.746150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:47.746117    5258 scope.go:122] "RemoveContainer" containerID="ea7f4b5f439ecf9225daa03d384abfde1247ed3911d13b81aff2b8780f2aa3a6"
Oct 30 22:23:47.748470 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:47.748436    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:23:47.748570 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:47.748505    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:23:47.748570 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:47.748541    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:23:48.776007 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:48.774761    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh" event={"ID":"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78","Type":"ContainerStarted","Data":"654f28ae14edc7bf5c3b69dde77ae60a129046ad9802ffe3e3f8710d9e8a76ca"}
Oct 30 22:23:49.119393 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:49.118928    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:23:49.119393 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:49.119144    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 30 22:23:49.119393 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:49.119180    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh" podUID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 30 22:23:49.426524 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:49.426441    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:49.734539 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:49.734368    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:50.151619 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:50.149006    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 30 22:23:50.151619 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:50.149083    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh" podUID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 30 22:23:50.224735 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:50.223993    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:51.119177 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:51.119135    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 30 22:23:51.119363 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:51.119205    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh" podUID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 30 22:23:52.118978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:52.118943    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 30 22:23:52.119579 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:52.119548    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh" podUID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 30 22:23:52.438932 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:52.438853    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"]
Oct 30 22:23:52.439163 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:52.439139    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm" podUID="aba4b2cc-918e-4a92-ba56-23066538cb59" containerName="istio-proxy" containerID="cri-o://39e2c28531926b16ca3b0b6d5c23abd3997028fe590481c3df55e516d07f8a6c" gracePeriod=30
Oct 30 22:23:52.891512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:52.886087    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"]
Oct 30 22:23:52.891512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:52.886333    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2" podUID="caa28d4f-9d58-4fca-9ff3-81aa4f47befe" containerName="istio-proxy" containerID="cri-o://58c413d7e6b85157f5bfbabb583dc67024b40725fa55d7611b4b8d1c52b04617" gracePeriod=30
Oct 30 22:23:53.118699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:53.118657    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused" start-of-body=
Oct 30 22:23:53.118879 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:53.118719    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh" podUID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.113:15021/healthz/ready\": dial tcp 10.132.0.113:15021: connect: connection refused"
Oct 30 22:23:53.538718 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:53.538680    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"]
Oct 30 22:23:53.539153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:53.538876    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b" podUID="57380917-8312-4d27-b610-ced9e601a8ef" containerName="istio-proxy" containerID="cri-o://e2d1555df790123154661db683c27d0e2f64410c9d35168d656424a6185e8dd5" gracePeriod=30
Oct 30 22:23:54.232904 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:54.232872    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:23:54.233409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:54.233382    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:23:54.234778 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:54.234752    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:23:54.417013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:54.416981    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:54.904169 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:54.904117    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:55.744627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:55.744555    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:56.226539 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:56.218903    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:56.451381 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:56.451347    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:57.351929 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.351888    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:23:57.352393 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.351959    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b" podUID="57380917-8312-4d27-b610-ced9e601a8ef" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:23:57.460682 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.460651    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:23:57.460849 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.460705    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2" podUID="caa28d4f-9d58-4fca-9ff3-81aa4f47befe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:23:57.744969 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.744941    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:23:57.880438 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.880348    5258 generic.go:356] "Generic (PLEG): container finished" podID="aba4b2cc-918e-4a92-ba56-23066538cb59" containerID="39e2c28531926b16ca3b0b6d5c23abd3997028fe590481c3df55e516d07f8a6c" exitCode=0
Oct 30 22:23:57.880438 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.880409    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"
Oct 30 22:23:57.880715 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.880691    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm" event={"ID":"aba4b2cc-918e-4a92-ba56-23066538cb59","Type":"ContainerDied","Data":"39e2c28531926b16ca3b0b6d5c23abd3997028fe590481c3df55e516d07f8a6c"}
Oct 30 22:23:57.880789 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.880759    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm" event={"ID":"aba4b2cc-918e-4a92-ba56-23066538cb59","Type":"ContainerDied","Data":"00957fc4c71154c851e1c30bb71cc8e956ca90decad2db072816638802b2b4be"}
Oct 30 22:23:57.880841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.880795    5258 scope.go:122] "RemoveContainer" containerID="39e2c28531926b16ca3b0b6d5c23abd3997028fe590481c3df55e516d07f8a6c"
Oct 30 22:23:57.896009 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.893354    5258 scope.go:122] "RemoveContainer" containerID="88482e144279642753d2408a24f2caa708a0b062e126fb05e584628ee49d3e9a"
Oct 30 22:23:57.905688 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.905667    5258 scope.go:122] "RemoveContainer" containerID="39e2c28531926b16ca3b0b6d5c23abd3997028fe590481c3df55e516d07f8a6c"
Oct 30 22:23:57.905992 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:23:57.905965    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39e2c28531926b16ca3b0b6d5c23abd3997028fe590481c3df55e516d07f8a6c\": container with ID starting with 39e2c28531926b16ca3b0b6d5c23abd3997028fe590481c3df55e516d07f8a6c not found: ID does not exist" containerID="39e2c28531926b16ca3b0b6d5c23abd3997028fe590481c3df55e516d07f8a6c"
Oct 30 22:23:57.906088 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.906002    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e2c28531926b16ca3b0b6d5c23abd3997028fe590481c3df55e516d07f8a6c"} err="failed to get container status \"39e2c28531926b16ca3b0b6d5c23abd3997028fe590481c3df55e516d07f8a6c\": rpc error: code = NotFound desc = could not find container \"39e2c28531926b16ca3b0b6d5c23abd3997028fe590481c3df55e516d07f8a6c\": container with ID starting with 39e2c28531926b16ca3b0b6d5c23abd3997028fe590481c3df55e516d07f8a6c not found: ID does not exist"
Oct 30 22:23:57.906088 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.906021    5258 scope.go:122] "RemoveContainer" containerID="88482e144279642753d2408a24f2caa708a0b062e126fb05e584628ee49d3e9a"
Oct 30 22:23:57.906321 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:23:57.906301    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88482e144279642753d2408a24f2caa708a0b062e126fb05e584628ee49d3e9a\": container with ID starting with 88482e144279642753d2408a24f2caa708a0b062e126fb05e584628ee49d3e9a not found: ID does not exist" containerID="88482e144279642753d2408a24f2caa708a0b062e126fb05e584628ee49d3e9a"
Oct 30 22:23:57.906399 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.906327    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88482e144279642753d2408a24f2caa708a0b062e126fb05e584628ee49d3e9a"} err="failed to get container status \"88482e144279642753d2408a24f2caa708a0b062e126fb05e584628ee49d3e9a\": rpc error: code = NotFound desc = could not find container \"88482e144279642753d2408a24f2caa708a0b062e126fb05e584628ee49d3e9a\": container with ID starting with 88482e144279642753d2408a24f2caa708a0b062e126fb05e584628ee49d3e9a not found: ID does not exist"
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.929632    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aba4b2cc-918e-4a92-ba56-23066538cb59-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aba4b2cc-918e-4a92-ba56-23066538cb59-istiod-ca-cert\") pod \"aba4b2cc-918e-4a92-ba56-23066538cb59\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") "
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.929679    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-credential-socket\") pod \"aba4b2cc-918e-4a92-ba56-23066538cb59\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") "
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.929712    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-workload-certs\") pod \"aba4b2cc-918e-4a92-ba56-23066538cb59\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") "
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.929821    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-envoy\") pod \"aba4b2cc-918e-4a92-ba56-23066538cb59\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") "
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.930042    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-credential-socket" pod "aba4b2cc-918e-4a92-ba56-23066538cb59" (UID: "aba4b2cc-918e-4a92-ba56-23066538cb59"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.930090    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-workload-socket\") pod \"aba4b2cc-918e-4a92-ba56-23066538cb59\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") "
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.930134    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-podinfo\") pod \"aba4b2cc-918e-4a92-ba56-23066538cb59\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") "
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.930219    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-token\" (UniqueName: \"kubernetes.io/projected/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-token\") pod \"aba4b2cc-918e-4a92-ba56-23066538cb59\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") "
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.930300    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-data\") pod \"aba4b2cc-918e-4a92-ba56-23066538cb59\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") "
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.930381    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aba4b2cc-918e-4a92-ba56-23066538cb59-kube-api-access-krmqm\" (UniqueName: \"kubernetes.io/projected/aba4b2cc-918e-4a92-ba56-23066538cb59-kube-api-access-krmqm\") pod \"aba4b2cc-918e-4a92-ba56-23066538cb59\" (UID: \"aba4b2cc-918e-4a92-ba56-23066538cb59\") "
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.930404    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aba4b2cc-918e-4a92-ba56-23066538cb59-istiod-ca-cert" pod "aba4b2cc-918e-4a92-ba56-23066538cb59" (UID: "aba4b2cc-918e-4a92-ba56-23066538cb59"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.930482    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-workload-certs" pod "aba4b2cc-918e-4a92-ba56-23066538cb59" (UID: "aba4b2cc-918e-4a92-ba56-23066538cb59"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.931116    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aba4b2cc-918e-4a92-ba56-23066538cb59-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.931140    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:57.931448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.931156    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:57.932458 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.931874    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-data" pod "aba4b2cc-918e-4a92-ba56-23066538cb59" (UID: "aba4b2cc-918e-4a92-ba56-23066538cb59"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:57.932458 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.932062    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-workload-socket" pod "aba4b2cc-918e-4a92-ba56-23066538cb59" (UID: "aba4b2cc-918e-4a92-ba56-23066538cb59"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:57.933454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.933420    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-token" pod "aba4b2cc-918e-4a92-ba56-23066538cb59" (UID: "aba4b2cc-918e-4a92-ba56-23066538cb59"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:57.935490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.935434    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-envoy" pod "aba4b2cc-918e-4a92-ba56-23066538cb59" (UID: "aba4b2cc-918e-4a92-ba56-23066538cb59"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:57.936678 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.936650    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-podinfo" pod "aba4b2cc-918e-4a92-ba56-23066538cb59" (UID: "aba4b2cc-918e-4a92-ba56-23066538cb59"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:23:57.936976 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:57.936939    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aba4b2cc-918e-4a92-ba56-23066538cb59-kube-api-access-krmqm" pod "aba4b2cc-918e-4a92-ba56-23066538cb59" (UID: "aba4b2cc-918e-4a92-ba56-23066538cb59"). InnerVolumeSpecName "kube-api-access-krmqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:58.041044 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.040509    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.041044 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.040549    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.041044 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.040563    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.041044 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.040577    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.041044 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.040628    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krmqm\" (UniqueName: \"kubernetes.io/projected/aba4b2cc-918e-4a92-ba56-23066538cb59-kube-api-access-krmqm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.041044 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.040648    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aba4b2cc-918e-4a92-ba56-23066538cb59-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.341573 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.341458    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:23:58.371169 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.371139    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"]
Oct 30 22:23:58.376658 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.376621    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-ntbvm"]
Oct 30 22:23:58.455461 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.455383    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-data" pod "caa28d4f-9d58-4fca-9ff3-81aa4f47befe" (UID: "caa28d4f-9d58-4fca-9ff3-81aa4f47befe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:58.456250 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.456230    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-data\") pod \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") "
Oct 30 22:23:58.456671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.456344    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-workload-certs\") pod \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") "
Oct 30 22:23:58.456671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.456411    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-workload-socket\") pod \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") "
Oct 30 22:23:58.456671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.456552    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istiod-ca-cert\") pod \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") "
Oct 30 22:23:58.456671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.456658    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-workload-certs" pod "caa28d4f-9d58-4fca-9ff3-81aa4f47befe" (UID: "caa28d4f-9d58-4fca-9ff3-81aa4f47befe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:58.456970 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.456669    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-envoy\") pod \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") "
Oct 30 22:23:58.456970 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.456756    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-token\" (UniqueName: \"kubernetes.io/projected/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-token\") pod \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") "
Oct 30 22:23:58.456970 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.456802    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-podinfo\") pod \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") "
Oct 30 22:23:58.456970 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.456896    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-kube-api-access-hlrnz\" (UniqueName: \"kubernetes.io/projected/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-kube-api-access-hlrnz\") pod \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") "
Oct 30 22:23:58.456970 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.456899    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-workload-socket" pod "caa28d4f-9d58-4fca-9ff3-81aa4f47befe" (UID: "caa28d4f-9d58-4fca-9ff3-81aa4f47befe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:58.456970 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.456935    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-credential-socket\") pod \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\" (UID: \"caa28d4f-9d58-4fca-9ff3-81aa4f47befe\") "
Oct 30 22:23:58.457724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.457699    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.457850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.457725    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.457850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.457742    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.457850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.457751    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istiod-ca-cert" pod "caa28d4f-9d58-4fca-9ff3-81aa4f47befe" (UID: "caa28d4f-9d58-4fca-9ff3-81aa4f47befe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:58.458028 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.457921    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-credential-socket" pod "caa28d4f-9d58-4fca-9ff3-81aa4f47befe" (UID: "caa28d4f-9d58-4fca-9ff3-81aa4f47befe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:58.460526 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.459661    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-podinfo" pod "caa28d4f-9d58-4fca-9ff3-81aa4f47befe" (UID: "caa28d4f-9d58-4fca-9ff3-81aa4f47befe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:23:58.460848 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.460822    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-envoy" pod "caa28d4f-9d58-4fca-9ff3-81aa4f47befe" (UID: "caa28d4f-9d58-4fca-9ff3-81aa4f47befe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:58.460931 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.460918    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-token" pod "caa28d4f-9d58-4fca-9ff3-81aa4f47befe" (UID: "caa28d4f-9d58-4fca-9ff3-81aa4f47befe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:58.461085 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.461053    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-kube-api-access-hlrnz" pod "caa28d4f-9d58-4fca-9ff3-81aa4f47befe" (UID: "caa28d4f-9d58-4fca-9ff3-81aa4f47befe"). InnerVolumeSpecName "kube-api-access-hlrnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:58.561910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.561881    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.561910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.561909    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.562067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.561918    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlrnz\" (UniqueName: \"kubernetes.io/projected/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-kube-api-access-hlrnz\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.562067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.561928    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.562067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.561937    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.562067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.561946    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caa28d4f-9d58-4fca-9ff3-81aa4f47befe-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.836314 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.836287    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:23:58.866714 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.866680    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-credential-socket\") pod \"57380917-8312-4d27-b610-ced9e601a8ef\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") "
Oct 30 22:23:58.866864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.866760    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-istio-data\") pod \"57380917-8312-4d27-b610-ced9e601a8ef\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") "
Oct 30 22:23:58.866864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.866814    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57380917-8312-4d27-b610-ced9e601a8ef-kube-api-access-7c2n9\" (UniqueName: \"kubernetes.io/projected/57380917-8312-4d27-b610-ced9e601a8ef-kube-api-access-7c2n9\") pod \"57380917-8312-4d27-b610-ced9e601a8ef\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") "
Oct 30 22:23:58.866864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.866850    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-istio-envoy\") pod \"57380917-8312-4d27-b610-ced9e601a8ef\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") "
Oct 30 22:23:58.867037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.866884    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-workload-certs\") pod \"57380917-8312-4d27-b610-ced9e601a8ef\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") "
Oct 30 22:23:58.867037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.866945    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57380917-8312-4d27-b610-ced9e601a8ef-istio-token\" (UniqueName: \"kubernetes.io/projected/57380917-8312-4d27-b610-ced9e601a8ef-istio-token\") pod \"57380917-8312-4d27-b610-ced9e601a8ef\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") "
Oct 30 22:23:58.867037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.866969    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/57380917-8312-4d27-b610-ced9e601a8ef-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57380917-8312-4d27-b610-ced9e601a8ef-istiod-ca-cert\") pod \"57380917-8312-4d27-b610-ced9e601a8ef\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") "
Oct 30 22:23:58.867037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.866984    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-credential-socket" pod "57380917-8312-4d27-b610-ced9e601a8ef" (UID: "57380917-8312-4d27-b610-ced9e601a8ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:58.867037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.867012    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/57380917-8312-4d27-b610-ced9e601a8ef-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57380917-8312-4d27-b610-ced9e601a8ef-istio-podinfo\") pod \"57380917-8312-4d27-b610-ced9e601a8ef\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") "
Oct 30 22:23:58.867299 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.867058    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-istio-data" pod "57380917-8312-4d27-b610-ced9e601a8ef" (UID: "57380917-8312-4d27-b610-ced9e601a8ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:58.867299 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.867150    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-workload-socket\") pod \"57380917-8312-4d27-b610-ced9e601a8ef\" (UID: \"57380917-8312-4d27-b610-ced9e601a8ef\") "
Oct 30 22:23:58.867558 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.867484    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-workload-socket" pod "57380917-8312-4d27-b610-ced9e601a8ef" (UID: "57380917-8312-4d27-b610-ced9e601a8ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:58.867699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.867672    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-workload-certs" pod "57380917-8312-4d27-b610-ced9e601a8ef" (UID: "57380917-8312-4d27-b610-ced9e601a8ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:58.867760 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.867741    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57380917-8312-4d27-b610-ced9e601a8ef-istiod-ca-cert" pod "57380917-8312-4d27-b610-ced9e601a8ef" (UID: "57380917-8312-4d27-b610-ced9e601a8ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:58.868240 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.868212    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.868350 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.868244    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.868350 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.868263    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57380917-8312-4d27-b610-ced9e601a8ef-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.868350 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.868279    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.868350 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.868293    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.869249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.869222    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57380917-8312-4d27-b610-ced9e601a8ef-istio-podinfo" pod "57380917-8312-4d27-b610-ced9e601a8ef" (UID: "57380917-8312-4d27-b610-ced9e601a8ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:23:58.869384 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.869310    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-istio-envoy" pod "57380917-8312-4d27-b610-ced9e601a8ef" (UID: "57380917-8312-4d27-b610-ced9e601a8ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:58.869384 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.869328    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57380917-8312-4d27-b610-ced9e601a8ef-kube-api-access-7c2n9" pod "57380917-8312-4d27-b610-ced9e601a8ef" (UID: "57380917-8312-4d27-b610-ced9e601a8ef"). InnerVolumeSpecName "kube-api-access-7c2n9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:58.869521 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.869501    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57380917-8312-4d27-b610-ced9e601a8ef-istio-token" pod "57380917-8312-4d27-b610-ced9e601a8ef" (UID: "57380917-8312-4d27-b610-ced9e601a8ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:58.890716 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.890693    5258 generic.go:356] "Generic (PLEG): container finished" podID="caa28d4f-9d58-4fca-9ff3-81aa4f47befe" containerID="58c413d7e6b85157f5bfbabb583dc67024b40725fa55d7611b4b8d1c52b04617" exitCode=0
Oct 30 22:23:58.890807 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.890732    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"
Oct 30 22:23:58.890807 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.890780    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2" event={"ID":"caa28d4f-9d58-4fca-9ff3-81aa4f47befe","Type":"ContainerDied","Data":"58c413d7e6b85157f5bfbabb583dc67024b40725fa55d7611b4b8d1c52b04617"}
Oct 30 22:23:58.890884 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.890828    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2" event={"ID":"caa28d4f-9d58-4fca-9ff3-81aa4f47befe","Type":"ContainerDied","Data":"0e976855e382c59b705b01232d6ca06ce56c9ddb9c46c664a64e157e0f92195c"}
Oct 30 22:23:58.890884 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.890851    5258 scope.go:122] "RemoveContainer" containerID="58c413d7e6b85157f5bfbabb583dc67024b40725fa55d7611b4b8d1c52b04617"
Oct 30 22:23:58.892298 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.892273    5258 generic.go:356] "Generic (PLEG): container finished" podID="57380917-8312-4d27-b610-ced9e601a8ef" containerID="e2d1555df790123154661db683c27d0e2f64410c9d35168d656424a6185e8dd5" exitCode=0
Oct 30 22:23:58.892385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.892311    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b" event={"ID":"57380917-8312-4d27-b610-ced9e601a8ef","Type":"ContainerDied","Data":"e2d1555df790123154661db683c27d0e2f64410c9d35168d656424a6185e8dd5"}
Oct 30 22:23:58.892385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.892331    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"
Oct 30 22:23:58.892385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.892353    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b" event={"ID":"57380917-8312-4d27-b610-ced9e601a8ef","Type":"ContainerDied","Data":"c1f27321fd2b1aa2a04657d7a09b1b45db64a4d08b2c356151a57a665a299941"}
Oct 30 22:23:58.903419 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.903398    5258 scope.go:122] "RemoveContainer" containerID="58c413d7e6b85157f5bfbabb583dc67024b40725fa55d7611b4b8d1c52b04617"
Oct 30 22:23:58.904405 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:23:58.904377    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c413d7e6b85157f5bfbabb583dc67024b40725fa55d7611b4b8d1c52b04617\": container with ID starting with 58c413d7e6b85157f5bfbabb583dc67024b40725fa55d7611b4b8d1c52b04617 not found: ID does not exist" containerID="58c413d7e6b85157f5bfbabb583dc67024b40725fa55d7611b4b8d1c52b04617"
Oct 30 22:23:58.904484 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.904415    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c413d7e6b85157f5bfbabb583dc67024b40725fa55d7611b4b8d1c52b04617"} err="failed to get container status \"58c413d7e6b85157f5bfbabb583dc67024b40725fa55d7611b4b8d1c52b04617\": rpc error: code = NotFound desc = could not find container \"58c413d7e6b85157f5bfbabb583dc67024b40725fa55d7611b4b8d1c52b04617\": container with ID starting with 58c413d7e6b85157f5bfbabb583dc67024b40725fa55d7611b4b8d1c52b04617 not found: ID does not exist"
Oct 30 22:23:58.904484 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.904444    5258 scope.go:122] "RemoveContainer" containerID="e2d1555df790123154661db683c27d0e2f64410c9d35168d656424a6185e8dd5"
Oct 30 22:23:58.914182 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.914167    5258 scope.go:122] "RemoveContainer" containerID="e2d1555df790123154661db683c27d0e2f64410c9d35168d656424a6185e8dd5"
Oct 30 22:23:58.914437 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:23:58.914417    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d1555df790123154661db683c27d0e2f64410c9d35168d656424a6185e8dd5\": container with ID starting with e2d1555df790123154661db683c27d0e2f64410c9d35168d656424a6185e8dd5 not found: ID does not exist" containerID="e2d1555df790123154661db683c27d0e2f64410c9d35168d656424a6185e8dd5"
Oct 30 22:23:58.914506 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.914443    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d1555df790123154661db683c27d0e2f64410c9d35168d656424a6185e8dd5"} err="failed to get container status \"e2d1555df790123154661db683c27d0e2f64410c9d35168d656424a6185e8dd5\": rpc error: code = NotFound desc = could not find container \"e2d1555df790123154661db683c27d0e2f64410c9d35168d656424a6185e8dd5\": container with ID starting with e2d1555df790123154661db683c27d0e2f64410c9d35168d656424a6185e8dd5 not found: ID does not exist"
Oct 30 22:23:58.969841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.969816    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c2n9\" (UniqueName: \"kubernetes.io/projected/57380917-8312-4d27-b610-ced9e601a8ef-kube-api-access-7c2n9\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.969841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.969839    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57380917-8312-4d27-b610-ced9e601a8ef-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.969976 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.969849    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57380917-8312-4d27-b610-ced9e601a8ef-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:58.969976 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:58.969859    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57380917-8312-4d27-b610-ced9e601a8ef-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:59.109109 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:59.109021    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"]
Oct 30 22:23:59.116051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:59.116023    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-n8ns2"]
Oct 30 22:23:59.225462 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:59.225426    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"]
Oct 30 22:23:59.231879 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:59.231847    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mrq7b"]
Oct 30 22:23:59.383790 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:59.383716    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="57380917-8312-4d27-b610-ced9e601a8ef" path="/var/lib/kubelet/pods/57380917-8312-4d27-b610-ced9e601a8ef/volumes"
Oct 30 22:23:59.384239 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:59.384224    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aba4b2cc-918e-4a92-ba56-23066538cb59" path="/var/lib/kubelet/pods/aba4b2cc-918e-4a92-ba56-23066538cb59/volumes"
Oct 30 22:23:59.384728 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:23:59.384714    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="caa28d4f-9d58-4fca-9ff3-81aa4f47befe" path="/var/lib/kubelet/pods/caa28d4f-9d58-4fca-9ff3-81aa4f47befe/volumes"
Oct 30 22:24:00.849613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:00.846141    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"]
Oct 30 22:24:00.849613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:00.846431    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92" podUID="ee19ff52-f6e8-4ebd-af0c-d8385855d860" containerName="maas-api" containerID="cri-o://0c9e7ee09fee860a4dcc54bae35802a5da39117c4551eeb86b20032dc84fb467" gracePeriod=30
Oct 30 22:24:00.977550 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:00.977484    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:01.207800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.207448    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:01.348672 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.348642    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:24:01.437310 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.437271    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:01.565964 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.564701    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ee19ff52-f6e8-4ebd-af0c-d8385855d860-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee19ff52-f6e8-4ebd-af0c-d8385855d860-openshift-service-ca\") pod \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") "
Oct 30 22:24:01.565964 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.564831    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-metrics-certs\") pod \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") "
Oct 30 22:24:01.565964 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.564961    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-maas-api-tls\") pod \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") "
Oct 30 22:24:01.565964 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.565020    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee19ff52-f6e8-4ebd-af0c-d8385855d860-kube-api-access-8wz2w\" (UniqueName: \"kubernetes.io/projected/ee19ff52-f6e8-4ebd-af0c-d8385855d860-kube-api-access-8wz2w\") pod \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\" (UID: \"ee19ff52-f6e8-4ebd-af0c-d8385855d860\") "
Oct 30 22:24:01.602410 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.597174    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee19ff52-f6e8-4ebd-af0c-d8385855d860-openshift-service-ca" pod "ee19ff52-f6e8-4ebd-af0c-d8385855d860" (UID: "ee19ff52-f6e8-4ebd-af0c-d8385855d860"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:01.612901 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.612845    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee19ff52-f6e8-4ebd-af0c-d8385855d860-kube-api-access-8wz2w" pod "ee19ff52-f6e8-4ebd-af0c-d8385855d860" (UID: "ee19ff52-f6e8-4ebd-af0c-d8385855d860"). InnerVolumeSpecName "kube-api-access-8wz2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:01.617664 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.617574    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-metrics-certs" pod "ee19ff52-f6e8-4ebd-af0c-d8385855d860" (UID: "ee19ff52-f6e8-4ebd-af0c-d8385855d860"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:01.620571 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.620519    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-maas-api-tls" pod "ee19ff52-f6e8-4ebd-af0c-d8385855d860" (UID: "ee19ff52-f6e8-4ebd-af0c-d8385855d860"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:01.676497 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.676399    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee19ff52-f6e8-4ebd-af0c-d8385855d860-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:01.676497 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.676432    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:01.676497 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.676448    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee19ff52-f6e8-4ebd-af0c-d8385855d860-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:01.676497 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.676462    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wz2w\" (UniqueName: \"kubernetes.io/projected/ee19ff52-f6e8-4ebd-af0c-d8385855d860-kube-api-access-8wz2w\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:01.962831 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.962740    5258 generic.go:356] "Generic (PLEG): container finished" podID="ee19ff52-f6e8-4ebd-af0c-d8385855d860" containerID="0c9e7ee09fee860a4dcc54bae35802a5da39117c4551eeb86b20032dc84fb467" exitCode=0
Oct 30 22:24:01.962831 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.962808    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92" event={"ID":"ee19ff52-f6e8-4ebd-af0c-d8385855d860","Type":"ContainerDied","Data":"0c9e7ee09fee860a4dcc54bae35802a5da39117c4551eeb86b20032dc84fb467"}
Oct 30 22:24:01.962831 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.962817    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"
Oct 30 22:24:01.963422 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.962857    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92" event={"ID":"ee19ff52-f6e8-4ebd-af0c-d8385855d860","Type":"ContainerDied","Data":"75a472a0dc0ccd84cb17b002393a15c20377eef4ee9c61264db9035e87805d6f"}
Oct 30 22:24:01.963422 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.962890    5258 scope.go:122] "RemoveContainer" containerID="0c9e7ee09fee860a4dcc54bae35802a5da39117c4551eeb86b20032dc84fb467"
Oct 30 22:24:01.976733 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.976700    5258 scope.go:122] "RemoveContainer" containerID="0c9e7ee09fee860a4dcc54bae35802a5da39117c4551eeb86b20032dc84fb467"
Oct 30 22:24:01.977066 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:24:01.977044    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c9e7ee09fee860a4dcc54bae35802a5da39117c4551eeb86b20032dc84fb467\": container with ID starting with 0c9e7ee09fee860a4dcc54bae35802a5da39117c4551eeb86b20032dc84fb467 not found: ID does not exist" containerID="0c9e7ee09fee860a4dcc54bae35802a5da39117c4551eeb86b20032dc84fb467"
Oct 30 22:24:01.977157 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:01.977078    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c9e7ee09fee860a4dcc54bae35802a5da39117c4551eeb86b20032dc84fb467"} err="failed to get container status \"0c9e7ee09fee860a4dcc54bae35802a5da39117c4551eeb86b20032dc84fb467\": rpc error: code = NotFound desc = could not find container \"0c9e7ee09fee860a4dcc54bae35802a5da39117c4551eeb86b20032dc84fb467\": container with ID starting with 0c9e7ee09fee860a4dcc54bae35802a5da39117c4551eeb86b20032dc84fb467 not found: ID does not exist"
Oct 30 22:24:02.165615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.153995    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"]
Oct 30 22:24:02.250741 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.240585    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-678b1628-58bd89844d-jcz92"]
Oct 30 22:24:02.959779 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.959747    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"]
Oct 30 22:24:02.960436 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960423    5258 cpu_manager.go:414] "containerMap: removing container" podUID="aba4b2cc-918e-4a92-ba56-23066538cb59" containerName="istio-proxy"
Oct 30 22:24:02.960501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960438    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aba4b2cc-918e-4a92-ba56-23066538cb59" containerName="istio-proxy"
Oct 30 22:24:02.960501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960455    5258 cpu_manager.go:414] "containerMap: removing container" podUID="57380917-8312-4d27-b610-ced9e601a8ef" containerName="istio-proxy"
Oct 30 22:24:02.960501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960460    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="57380917-8312-4d27-b610-ced9e601a8ef" containerName="istio-proxy"
Oct 30 22:24:02.960501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960476    5258 cpu_manager.go:414] "containerMap: removing container" podUID="19b956fb-6a5f-4e18-800b-a94cb43dba93" containerName="istio-proxy"
Oct 30 22:24:02.960501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960481    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="19b956fb-6a5f-4e18-800b-a94cb43dba93" containerName="istio-proxy"
Oct 30 22:24:02.960501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960490    5258 cpu_manager.go:414] "containerMap: removing container" podUID="ee19ff52-f6e8-4ebd-af0c-d8385855d860" containerName="maas-api"
Oct 30 22:24:02.960501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960494    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee19ff52-f6e8-4ebd-af0c-d8385855d860" containerName="maas-api"
Oct 30 22:24:02.960756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960518    5258 cpu_manager.go:414] "containerMap: removing container" podUID="caa28d4f-9d58-4fca-9ff3-81aa4f47befe" containerName="istio-proxy"
Oct 30 22:24:02.960756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960526    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="caa28d4f-9d58-4fca-9ff3-81aa4f47befe" containerName="istio-proxy"
Oct 30 22:24:02.960756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960661    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee19ff52-f6e8-4ebd-af0c-d8385855d860" containerName="maas-api"
Oct 30 22:24:02.960756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960674    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="aba4b2cc-918e-4a92-ba56-23066538cb59" containerName="istio-proxy"
Oct 30 22:24:02.960756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960682    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="caa28d4f-9d58-4fca-9ff3-81aa4f47befe" containerName="istio-proxy"
Oct 30 22:24:02.960756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960692    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="aba4b2cc-918e-4a92-ba56-23066538cb59" containerName="istio-proxy"
Oct 30 22:24:02.960756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960698    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="57380917-8312-4d27-b610-ced9e601a8ef" containerName="istio-proxy"
Oct 30 22:24:02.960756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.960705    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="19b956fb-6a5f-4e18-800b-a94cb43dba93" containerName="istio-proxy"
Oct 30 22:24:02.964340 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:02.964303    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.016864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.016833    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-18515933-serving-cert\""
Oct 30 22:24:03.034671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.034642    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmcwx\" (UniqueName: \"kubernetes.io/projected/f9cf2d59-e154-45ce-864e-675a1251feee-kube-api-access-zmcwx\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.034815 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.034709    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9cf2d59-e154-45ce-864e-675a1251feee-openshift-service-ca\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.034919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.034898    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-maas-api-tls\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.035041 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.035021    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-metrics-certs\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.076489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.076448    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"]
Oct 30 22:24:03.086191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.086103    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:03.137229 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.137186    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmcwx\" (UniqueName: \"kubernetes.io/projected/f9cf2d59-e154-45ce-864e-675a1251feee-kube-api-access-zmcwx\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.137428 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.137286    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9cf2d59-e154-45ce-864e-675a1251feee-openshift-service-ca\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.137511 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.137489    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-maas-api-tls\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.137656 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.137634    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-metrics-certs\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.143264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.138416    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9cf2d59-e154-45ce-864e-675a1251feee-openshift-service-ca\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.143264 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:24:03.138542    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-18515933-serving-cert: secret "maas-api-e2e-mt-18515933-serving-cert" not found
Oct 30 22:24:03.143264 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:24:03.138626    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-maas-api-tls podName:f9cf2d59-e154-45ce-864e-675a1251feee nodeName:}" failed. No retries permitted until 2026-10-30 22:24:03.638606989 +0000 UTC m=+1758.369464137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-maas-api-tls") pod "maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp" (UID: "f9cf2d59-e154-45ce-864e-675a1251feee") : secret "maas-api-e2e-mt-18515933-serving-cert" not found
Oct 30 22:24:03.143264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.141014    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-metrics-certs\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.206877 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.206832    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmcwx\" (UniqueName: \"kubernetes.io/projected/f9cf2d59-e154-45ce-864e-675a1251feee-kube-api-access-zmcwx\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.356770 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.356731    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:03.384675 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.384640    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee19ff52-f6e8-4ebd-af0c-d8385855d860" path="/var/lib/kubelet/pods/ee19ff52-f6e8-4ebd-af0c-d8385855d860/volumes"
Oct 30 22:24:03.646517 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.646434    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-maas-api-tls\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.649091 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.649064    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-maas-api-tls\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.658055 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.658027    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:03.882706 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.881882    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:03.917139 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:03.917104    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:04.443307 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:04.443278    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"]
Oct 30 22:24:04.443920 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:24:04.443893    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9cf2d59_e154_45ce_864e_675a1251feee.slice/crio-eaa000cb51601b264b85e481bfd82a84cf02cb7e93eae31e3e0a9c7b112878e8 WatchSource:0}: Error finding container eaa000cb51601b264b85e481bfd82a84cf02cb7e93eae31e3e0a9c7b112878e8: Status 404 returned error can't find the container with id eaa000cb51601b264b85e481bfd82a84cf02cb7e93eae31e3e0a9c7b112878e8
Oct 30 22:24:04.445451 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:04.445434    5258 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:24:04.635136 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:04.635098    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:04.917289 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:04.917252    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:05.027347 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.027310    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp" event={"ID":"f9cf2d59-e154-45ce-864e-675a1251feee","Type":"ContainerStarted","Data":"eaa000cb51601b264b85e481bfd82a84cf02cb7e93eae31e3e0a9c7b112878e8"}
Oct 30 22:24:05.153695 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.153665    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"]
Oct 30 22:24:05.154383 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.154365    5258 cpu_manager.go:414] "containerMap: removing container" podUID="aba4b2cc-918e-4a92-ba56-23066538cb59" containerName="istio-proxy"
Oct 30 22:24:05.154383 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.154381    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aba4b2cc-918e-4a92-ba56-23066538cb59" containerName="istio-proxy"
Oct 30 22:24:05.158214 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.158188    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.184341 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.184310    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-workload-certs\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.184455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.184423    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6flm8\" (UniqueName: \"kubernetes.io/projected/878e5b5e-2d16-4105-9646-98904fcce19c-kube-api-access-6flm8\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.184522 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.184477    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-istio-data\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.184737 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.184717    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878e5b5e-2d16-4105-9646-98904fcce19c-istiod-ca-cert\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.184923 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.184899    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878e5b5e-2d16-4105-9646-98904fcce19c-istio-podinfo\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.184969 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.184943    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-istio-envoy\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.185065 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.185046    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-credential-socket\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.185111 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.185082    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-workload-socket\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.185195 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.185178    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878e5b5e-2d16-4105-9646-98904fcce19c-istio-token\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.213184 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.213145    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w5-53cceb-openshift-default-dockercfg-xck8x\""
Oct 30 22:24:05.269801 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.269757    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"]
Oct 30 22:24:05.295819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.295786    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6flm8\" (UniqueName: \"kubernetes.io/projected/878e5b5e-2d16-4105-9646-98904fcce19c-kube-api-access-6flm8\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.295975 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.295848    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-istio-data\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.296051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.296035    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878e5b5e-2d16-4105-9646-98904fcce19c-istiod-ca-cert\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.296192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.296163    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878e5b5e-2d16-4105-9646-98904fcce19c-istio-podinfo\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.296274 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.296200    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-istio-envoy\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.296274 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.296233    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-istio-data\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.296274 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.296241    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-credential-socket\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.296440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.296321    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-workload-socket\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.296440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.296385    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878e5b5e-2d16-4105-9646-98904fcce19c-istio-token\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.296440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.296432    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-workload-certs\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.296611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.296526    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-credential-socket\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.296941 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.296916    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878e5b5e-2d16-4105-9646-98904fcce19c-istiod-ca-cert\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.297096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.297072    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-workload-socket\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.297220 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.297184    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-workload-certs\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.299697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.299677    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-istio-envoy\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.302546 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.302525    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878e5b5e-2d16-4105-9646-98904fcce19c-istio-podinfo\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.341612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.338071    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:05.466826 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.466732    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6flm8\" (UniqueName: \"kubernetes.io/projected/878e5b5e-2d16-4105-9646-98904fcce19c-kube-api-access-6flm8\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.474518 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.474056    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878e5b5e-2d16-4105-9646-98904fcce19c-istio-token\") pod \"e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") " pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.481868 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.480164    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:05.599186 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.599154    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:05.995330 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:05.995297    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"]
Oct 30 22:24:05.999171 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:24:05.999144    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod878e5b5e_2d16_4105_9646_98904fcce19c.slice/crio-3c2fa40f894bc96fd4f5721bca42fe027ec6b03096621dcafbd7339452c099a6 WatchSource:0}: Error finding container 3c2fa40f894bc96fd4f5721bca42fe027ec6b03096621dcafbd7339452c099a6: Status 404 returned error can't find the container with id 3c2fa40f894bc96fd4f5721bca42fe027ec6b03096621dcafbd7339452c099a6
Oct 30 22:24:06.004830 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:06.004799    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:24:06.004920 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:06.004868    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:24:06.004920 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:06.004905    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:24:06.036666 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:06.036637    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6" event={"ID":"878e5b5e-2d16-4105-9646-98904fcce19c","Type":"ContainerStarted","Data":"3c2fa40f894bc96fd4f5721bca42fe027ec6b03096621dcafbd7339452c099a6"}
Oct 30 22:24:06.038572 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:06.038545    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp" event={"ID":"f9cf2d59-e154-45ce-864e-675a1251feee","Type":"ContainerStarted","Data":"467e967d010df484da201ba651dfa9053305b8585af0a10bef48f90cecc5e8a7"}
Oct 30 22:24:06.038715 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:06.038663    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:06.165074 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:06.165009    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp" podStartSLOduration=3.360261644 podStartE2EDuration="4.164988913s" totalImagesPullingTime="804.727269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:24:06.163050187 +0000 UTC m=+1760.893907333" watchObservedRunningTime="2026-10-30 22:24:06.164988913 +0000 UTC m=+1760.895846058"
Oct 30 22:24:06.205259 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:06.204909    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:07.048910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:07.048867    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6" event={"ID":"878e5b5e-2d16-4105-9646-98904fcce19c","Type":"ContainerStarted","Data":"477eb3cd6be55dd5daa2ce9c8c151003b2095c03605dfe91a50e929f426afd33"}
Oct 30 22:24:07.193613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:07.192369    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6" podStartSLOduration=2.192348907 podStartE2EDuration="2.192348907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:24:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:24:07.190998937 +0000 UTC m=+1761.921856105" watchObservedRunningTime="2026-10-30 22:24:07.192348907 +0000 UTC m=+1761.923206068"
Oct 30 22:24:07.349373 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:07.349337    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:07.481613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:07.480766    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:07.490002 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:07.489968    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:07.611773 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:07.605632    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:08.073313 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:08.073284    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:08.085624 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:08.079811    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:24:08.419946 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:08.419849    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:08.687783 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:08.687686    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:09.906647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:09.901273    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:10.421644 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:10.421575    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:10.695959 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:10.695865    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:12.054306 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:12.054270    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:24:13.165611 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:24:13.165559    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:24:13.201007 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.200979    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"]
Oct 30 22:24:13.204373 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.204357    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.267512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.267486    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a988d31-7005-41b0-ac0f-035ffa56d327-istiod-ca-cert\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.267668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.267541    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-token\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.267714 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.267694    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-podinfo\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.267760 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.267747    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9xss\" (UniqueName: \"kubernetes.io/projected/8a988d31-7005-41b0-ac0f-035ffa56d327-kube-api-access-c9xss\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.267835 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.267820    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-credential-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.267941 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.267928    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-workload-certs\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.267973 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.267960    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-workload-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.268044 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.268032    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-envoy\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.268076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.268054    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-data\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.369236 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.369198    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-credential-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.369399 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.369353    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-workload-certs\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.369458 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.369400    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-workload-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.369516 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.369476    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-envoy\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.369516 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.369504    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-data\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.369686 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.369560    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a988d31-7005-41b0-ac0f-035ffa56d327-istiod-ca-cert\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.369759 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.369681    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-token\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.369759 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.369695    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-credential-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.369869 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.369773    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-workload-certs\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.369869 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.369804    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-podinfo\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.370023 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.369901    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9xss\" (UniqueName: \"kubernetes.io/projected/8a988d31-7005-41b0-ac0f-035ffa56d327-kube-api-access-c9xss\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.370315 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.370287    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-data\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.370800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.370771    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a988d31-7005-41b0-ac0f-035ffa56d327-istiod-ca-cert\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.371100 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.371075    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-workload-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.372737 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.372679    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-envoy\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.378828 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.378802    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-podinfo\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.412797 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.412766    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"]
Oct 30 22:24:13.433323 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.433222    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-token\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.447832 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.447798    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9xss\" (UniqueName: \"kubernetes.io/projected/8a988d31-7005-41b0-ac0f-035ffa56d327-kube-api-access-c9xss\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.517444 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.517414    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:13.974008 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.973975    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"]
Oct 30 22:24:13.974171 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:24:13.973981    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a988d31_7005_41b0_ac0f_035ffa56d327.slice/crio-810036ff7a9b6093a78c9d4af085a20ee77527fea305a8a44b81c2bdf9d79d2d WatchSource:0}: Error finding container 810036ff7a9b6093a78c9d4af085a20ee77527fea305a8a44b81c2bdf9d79d2d: Status 404 returned error can't find the container with id 810036ff7a9b6093a78c9d4af085a20ee77527fea305a8a44b81c2bdf9d79d2d
Oct 30 22:24:13.977514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.977475    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:24:13.977658 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.977560    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:24:13.977658 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:13.977641    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:24:14.149407 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:14.149365    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b" event={"ID":"8a988d31-7005-41b0-ac0f-035ffa56d327","Type":"ContainerStarted","Data":"703555a5870cb96f6d88001da8a472b1ed1f03bdee8bc391d8593649dad8c418"}
Oct 30 22:24:14.149615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:14.149457    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b" event={"ID":"8a988d31-7005-41b0-ac0f-035ffa56d327","Type":"ContainerStarted","Data":"810036ff7a9b6093a78c9d4af085a20ee77527fea305a8a44b81c2bdf9d79d2d"}
Oct 30 22:24:14.275631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:14.275512    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b" podStartSLOduration=1.275496454 podStartE2EDuration="1.275496454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:24:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:24:14.272102407 +0000 UTC m=+1769.002959550" watchObservedRunningTime="2026-10-30 22:24:14.275496454 +0000 UTC m=+1769.006353597"
Oct 30 22:24:14.489720 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:14.489685    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:14.524753 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:14.524710    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:15.519385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:15.519351    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused" start-of-body=
Oct 30 22:24:15.519793 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:15.519414    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b" podUID="8a988d31-7005-41b0-ac0f-035ffa56d327" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused"
Oct 30 22:24:15.842260 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:15.842223    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:16.517980 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:16.517944    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused" start-of-body=
Oct 30 22:24:16.518202 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:16.518014    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b" podUID="8a988d31-7005-41b0-ac0f-035ffa56d327" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused"
Oct 30 22:24:17.517854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:17.517818    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused" start-of-body=
Oct 30 22:24:17.518281 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:17.517872    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b" podUID="8a988d31-7005-41b0-ac0f-035ffa56d327" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused"
Oct 30 22:24:18.116148 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:18.116055    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:18.517845 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:18.517762    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused" start-of-body=
Oct 30 22:24:18.517845 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:18.517821    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b" podUID="8a988d31-7005-41b0-ac0f-035ffa56d327" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused"
Oct 30 22:24:18.588540 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:18.588501    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:19.087743 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:19.087705    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"]
Oct 30 22:24:19.088234 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:19.088184    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf" podUID="e6595215-80bd-4584-8731-fce09ff3905a" containerName="istio-proxy" containerID="cri-o://7a2a7f8b915008c06188c9dc6a6fa6fd4aa9881dc47c317b08ed7709abe57bb1" gracePeriod=30
Oct 30 22:24:19.131409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:19.131373    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"]
Oct 30 22:24:19.131936 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:19.131883    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829" podUID="7d1b3a95-dfb1-44d6-9910-3437d0a0e313" containerName="istio-proxy" containerID="cri-o://944279adfc7d8b4e23c212250bff02526a010be8f9002bac6a69e62fedc4474b" gracePeriod=30
Oct 30 22:24:19.170612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:19.168490    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"]
Oct 30 22:24:19.170612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:19.168773    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r" podUID="8af4edd7-4096-4c60-bd9f-c24610207d8e" containerName="istio-proxy" containerID="cri-o://07ff0129421b96b5e450ebc9745960d79fc2b57a22dddb131cc8cf61d850efe3" gracePeriod=30
Oct 30 22:24:19.194420 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:19.194382    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"]
Oct 30 22:24:19.194876 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:19.194844    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2" podUID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerName="istio-proxy" containerID="cri-o://81a5e794a61a8be7c9dc18e6f021d8a776424b9e06152b0ea9f03ab0ac47e13a" gracePeriod=30
Oct 30 22:24:19.385670 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:19.384971    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:19.639765 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:19.638247    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused" start-of-body=
Oct 30 22:24:19.639765 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:19.638306    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b" podUID="8a988d31-7005-41b0-ac0f-035ffa56d327" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.121:15021/healthz/ready\": dial tcp 10.132.0.121:15021: connect: connection refused"
Oct 30 22:24:19.767651 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:19.753180    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:19.983351 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:19.983249    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:20.206415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:20.206371    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:20.522971 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:20.522942    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:20.523440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:20.523417    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:20.524164 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:20.524147    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:24:22.699619 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:22.698094    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:23.613798 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:23.613761    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:24:23.613980 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:23.613826    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r" podUID="8af4edd7-4096-4c60-bd9f-c24610207d8e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:24:24.327701 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.327492    5258 generic.go:356] "Generic (PLEG): container finished" podID="8af4edd7-4096-4c60-bd9f-c24610207d8e" containerID="07ff0129421b96b5e450ebc9745960d79fc2b57a22dddb131cc8cf61d850efe3" exitCode=0
Oct 30 22:24:24.327701 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.327640    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r" event={"ID":"8af4edd7-4096-4c60-bd9f-c24610207d8e","Type":"ContainerDied","Data":"07ff0129421b96b5e450ebc9745960d79fc2b57a22dddb131cc8cf61d850efe3"}
Oct 30 22:24:24.330381 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.330357    5258 generic.go:356] "Generic (PLEG): container finished" podID="e6595215-80bd-4584-8731-fce09ff3905a" containerID="7a2a7f8b915008c06188c9dc6a6fa6fd4aa9881dc47c317b08ed7709abe57bb1" exitCode=0
Oct 30 22:24:24.330553 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.330533    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf" event={"ID":"e6595215-80bd-4584-8731-fce09ff3905a","Type":"ContainerDied","Data":"7a2a7f8b915008c06188c9dc6a6fa6fd4aa9881dc47c317b08ed7709abe57bb1"}
Oct 30 22:24:24.335989 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.334747    5258 generic.go:356] "Generic (PLEG): container finished" podID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerID="81a5e794a61a8be7c9dc18e6f021d8a776424b9e06152b0ea9f03ab0ac47e13a" exitCode=0
Oct 30 22:24:24.335989 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.334921    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2" event={"ID":"bad7c750-19d5-4dfd-b9d9-0a51e8696cad","Type":"ContainerDied","Data":"81a5e794a61a8be7c9dc18e6f021d8a776424b9e06152b0ea9f03ab0ac47e13a"}
Oct 30 22:24:24.335989 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.334976    5258 scope.go:122] "RemoveContainer" containerID="8c5ed8f60becddecce10e823a01fb98958d669d12669bf97f8103a4a1886082e"
Oct 30 22:24:24.339268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.338769    5258 generic.go:356] "Generic (PLEG): container finished" podID="7d1b3a95-dfb1-44d6-9910-3437d0a0e313" containerID="944279adfc7d8b4e23c212250bff02526a010be8f9002bac6a69e62fedc4474b" exitCode=0
Oct 30 22:24:24.339268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.338842    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829" event={"ID":"7d1b3a95-dfb1-44d6-9910-3437d0a0e313","Type":"ContainerDied","Data":"944279adfc7d8b4e23c212250bff02526a010be8f9002bac6a69e62fedc4474b"}
Oct 30 22:24:24.451133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.451106    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:24:24.534100 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.534064    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:24:24.537815 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.537793    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:24:24.570871 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.570849    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:24:24.577556 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.577534    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e6595215-80bd-4584-8731-fce09ff3905a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6595215-80bd-4584-8731-fce09ff3905a-istiod-ca-cert\") pod \"e6595215-80bd-4584-8731-fce09ff3905a\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") "
Oct 30 22:24:24.577688 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.577577    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-workload-socket\") pod \"e6595215-80bd-4584-8731-fce09ff3905a\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") "
Oct 30 22:24:24.577688 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.577614    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-credential-socket\") pod \"e6595215-80bd-4584-8731-fce09ff3905a\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") "
Oct 30 22:24:24.577800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.577692    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e6595215-80bd-4584-8731-fce09ff3905a-kube-api-access-dh445\" (UniqueName: \"kubernetes.io/projected/e6595215-80bd-4584-8731-fce09ff3905a-kube-api-access-dh445\") pod \"e6595215-80bd-4584-8731-fce09ff3905a\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") "
Oct 30 22:24:24.577851 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.577799    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e6595215-80bd-4584-8731-fce09ff3905a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6595215-80bd-4584-8731-fce09ff3905a-istio-podinfo\") pod \"e6595215-80bd-4584-8731-fce09ff3905a\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") "
Oct 30 22:24:24.577902 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.577889    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-workload-socket" pod "e6595215-80bd-4584-8731-fce09ff3905a" (UID: "e6595215-80bd-4584-8731-fce09ff3905a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.577965 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.577905    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e6595215-80bd-4584-8731-fce09ff3905a-istio-token\" (UniqueName: \"kubernetes.io/projected/e6595215-80bd-4584-8731-fce09ff3905a-istio-token\") pod \"e6595215-80bd-4584-8731-fce09ff3905a\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") "
Oct 30 22:24:24.578022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.578004    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-istio-data\") pod \"e6595215-80bd-4584-8731-fce09ff3905a\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") "
Oct 30 22:24:24.578116 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.578073    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-istio-envoy\") pod \"e6595215-80bd-4584-8731-fce09ff3905a\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") "
Oct 30 22:24:24.578184 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.578152    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-workload-certs\") pod \"e6595215-80bd-4584-8731-fce09ff3905a\" (UID: \"e6595215-80bd-4584-8731-fce09ff3905a\") "
Oct 30 22:24:24.578268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.578070    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6595215-80bd-4584-8731-fce09ff3905a-istiod-ca-cert" pod "e6595215-80bd-4584-8731-fce09ff3905a" (UID: "e6595215-80bd-4584-8731-fce09ff3905a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:24.578268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.578072    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-credential-socket" pod "e6595215-80bd-4584-8731-fce09ff3905a" (UID: "e6595215-80bd-4584-8731-fce09ff3905a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.578394 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.578335    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-istio-data" pod "e6595215-80bd-4584-8731-fce09ff3905a" (UID: "e6595215-80bd-4584-8731-fce09ff3905a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.578709 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.578673    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-workload-certs" pod "e6595215-80bd-4584-8731-fce09ff3905a" (UID: "e6595215-80bd-4584-8731-fce09ff3905a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.578996 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.578970    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.579090 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.579000    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6595215-80bd-4584-8731-fce09ff3905a-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.579090 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.579018    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.579090 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.579033    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.579090 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.579048    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.580184 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.580160    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6595215-80bd-4584-8731-fce09ff3905a-istio-podinfo" pod "e6595215-80bd-4584-8731-fce09ff3905a" (UID: "e6595215-80bd-4584-8731-fce09ff3905a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:24:24.580413 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.580392    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6595215-80bd-4584-8731-fce09ff3905a-kube-api-access-dh445" pod "e6595215-80bd-4584-8731-fce09ff3905a" (UID: "e6595215-80bd-4584-8731-fce09ff3905a"). InnerVolumeSpecName "kube-api-access-dh445". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:24.580655 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.580602    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-istio-envoy" pod "e6595215-80bd-4584-8731-fce09ff3905a" (UID: "e6595215-80bd-4584-8731-fce09ff3905a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.580739 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.580654    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6595215-80bd-4584-8731-fce09ff3905a-istio-token" pod "e6595215-80bd-4584-8731-fce09ff3905a" (UID: "e6595215-80bd-4584-8731-fce09ff3905a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:24.679783 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.679692    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-data\") pod \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") "
Oct 30 22:24:24.679783 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.679748    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-data\") pod \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") "
Oct 30 22:24:24.680014 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.679798    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-credential-socket\") pod \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") "
Oct 30 22:24:24.680014 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.679842    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istiod-ca-cert\") pod \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") "
Oct 30 22:24:24.680014 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.679879    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8af4edd7-4096-4c60-bd9f-c24610207d8e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af4edd7-4096-4c60-bd9f-c24610207d8e-istiod-ca-cert\") pod \"8af4edd7-4096-4c60-bd9f-c24610207d8e\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") "
Oct 30 22:24:24.680014 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.679921    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-workload-socket\") pod \"8af4edd7-4096-4c60-bd9f-c24610207d8e\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") "
Oct 30 22:24:24.680014 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.679965    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-token\" (UniqueName: \"kubernetes.io/projected/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-token\") pod \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") "
Oct 30 22:24:24.680278 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.680046    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-credential-socket\") pod \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") "
Oct 30 22:24:24.680278 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.680096    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-workload-certs\") pod \"8af4edd7-4096-4c60-bd9f-c24610207d8e\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") "
Oct 30 22:24:24.680278 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.680125    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-podinfo\") pod \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") "
Oct 30 22:24:24.680278 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.680168    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-workload-socket\") pod \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") "
Oct 30 22:24:24.680278 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.680199    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-podinfo\") pod \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") "
Oct 30 22:24:24.680278 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.680225    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-token\" (UniqueName: \"kubernetes.io/projected/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-token\") pod \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") "
Oct 30 22:24:24.680278 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.680257    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-kube-api-access-5f8hp\" (UniqueName: \"kubernetes.io/projected/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-kube-api-access-5f8hp\") pod \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") "
Oct 30 22:24:24.680653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.680342    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-podinfo\") pod \"8af4edd7-4096-4c60-bd9f-c24610207d8e\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") "
Oct 30 22:24:24.680653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.680378    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-data\") pod \"8af4edd7-4096-4c60-bd9f-c24610207d8e\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") "
Oct 30 22:24:24.680653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.680446    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-envoy\") pod \"8af4edd7-4096-4c60-bd9f-c24610207d8e\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") "
Oct 30 22:24:24.680653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.680476    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-envoy\") pod \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") "
Oct 30 22:24:24.680653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.680537    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-credential-socket\") pod \"8af4edd7-4096-4c60-bd9f-c24610207d8e\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") "
Oct 30 22:24:24.680653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.680583    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8af4edd7-4096-4c60-bd9f-c24610207d8e-kube-api-access-lbnc5\" (UniqueName: \"kubernetes.io/projected/8af4edd7-4096-4c60-bd9f-c24610207d8e-kube-api-access-lbnc5\") pod \"8af4edd7-4096-4c60-bd9f-c24610207d8e\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") "
Oct 30 22:24:24.681212 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.681186    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-envoy\") pod \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") "
Oct 30 22:24:24.681319 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.681301    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-kube-api-access-4xnls\" (UniqueName: \"kubernetes.io/projected/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-kube-api-access-4xnls\") pod \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") "
Oct 30 22:24:24.681407 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.681391    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-token\" (UniqueName: \"kubernetes.io/projected/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-token\") pod \"8af4edd7-4096-4c60-bd9f-c24610207d8e\" (UID: \"8af4edd7-4096-4c60-bd9f-c24610207d8e\") "
Oct 30 22:24:24.681459 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.681430    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-workload-socket\") pod \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") "
Oct 30 22:24:24.681516 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.681468    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-workload-certs\") pod \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") "
Oct 30 22:24:24.681569 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.681532    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istiod-ca-cert\") pod \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\" (UID: \"bad7c750-19d5-4dfd-b9d9-0a51e8696cad\") "
Oct 30 22:24:24.681646 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.681608    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-workload-certs\") pod \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\" (UID: \"7d1b3a95-dfb1-44d6-9910-3437d0a0e313\") "
Oct 30 22:24:24.682607 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.682570    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh445\" (UniqueName: \"kubernetes.io/projected/e6595215-80bd-4584-8731-fce09ff3905a-kube-api-access-dh445\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.685008 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.684981    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6595215-80bd-4584-8731-fce09ff3905a-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.685105 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.685024    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6595215-80bd-4584-8731-fce09ff3905a-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.685105 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.685053    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6595215-80bd-4584-8731-fce09ff3905a-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.685105 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.683117    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-workload-socket" pod "8af4edd7-4096-4c60-bd9f-c24610207d8e" (UID: "8af4edd7-4096-4c60-bd9f-c24610207d8e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.685105 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.683209    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-workload-certs" pod "7d1b3a95-dfb1-44d6-9910-3437d0a0e313" (UID: "7d1b3a95-dfb1-44d6-9910-3437d0a0e313"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.685105 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.683422    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-workload-socket" pod "7d1b3a95-dfb1-44d6-9910-3437d0a0e313" (UID: "7d1b3a95-dfb1-44d6-9910-3437d0a0e313"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.685105 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.683746    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-data" pod "7d1b3a95-dfb1-44d6-9910-3437d0a0e313" (UID: "7d1b3a95-dfb1-44d6-9910-3437d0a0e313"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.685105 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.683678    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8af4edd7-4096-4c60-bd9f-c24610207d8e-istiod-ca-cert" pod "8af4edd7-4096-4c60-bd9f-c24610207d8e" (UID: "8af4edd7-4096-4c60-bd9f-c24610207d8e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:24.685519 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.684011    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-data" pod "bad7c750-19d5-4dfd-b9d9-0a51e8696cad" (UID: "bad7c750-19d5-4dfd-b9d9-0a51e8696cad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.685519 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.684030    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-credential-socket" pod "bad7c750-19d5-4dfd-b9d9-0a51e8696cad" (UID: "bad7c750-19d5-4dfd-b9d9-0a51e8696cad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.685519 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.684188    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-credential-socket" pod "7d1b3a95-dfb1-44d6-9910-3437d0a0e313" (UID: "7d1b3a95-dfb1-44d6-9910-3437d0a0e313"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.685519 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.684520    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istiod-ca-cert" pod "7d1b3a95-dfb1-44d6-9910-3437d0a0e313" (UID: "7d1b3a95-dfb1-44d6-9910-3437d0a0e313"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:24.685519 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.684622    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-credential-socket" pod "8af4edd7-4096-4c60-bd9f-c24610207d8e" (UID: "8af4edd7-4096-4c60-bd9f-c24610207d8e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.685519 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.685324    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-workload-certs" pod "8af4edd7-4096-4c60-bd9f-c24610207d8e" (UID: "8af4edd7-4096-4c60-bd9f-c24610207d8e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.685519 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.685508    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-workload-certs" pod "bad7c750-19d5-4dfd-b9d9-0a51e8696cad" (UID: "bad7c750-19d5-4dfd-b9d9-0a51e8696cad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.686614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.685724    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-workload-socket" pod "bad7c750-19d5-4dfd-b9d9-0a51e8696cad" (UID: "bad7c750-19d5-4dfd-b9d9-0a51e8696cad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.686614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.685908    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-data" pod "8af4edd7-4096-4c60-bd9f-c24610207d8e" (UID: "8af4edd7-4096-4c60-bd9f-c24610207d8e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.686614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.685993    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istiod-ca-cert" pod "bad7c750-19d5-4dfd-b9d9-0a51e8696cad" (UID: "bad7c750-19d5-4dfd-b9d9-0a51e8696cad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:24.693839 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.693813    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-kube-api-access-4xnls" pod "7d1b3a95-dfb1-44d6-9910-3437d0a0e313" (UID: "7d1b3a95-dfb1-44d6-9910-3437d0a0e313"). InnerVolumeSpecName "kube-api-access-4xnls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:24.694526 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.694312    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-kube-api-access-5f8hp" pod "bad7c750-19d5-4dfd-b9d9-0a51e8696cad" (UID: "bad7c750-19d5-4dfd-b9d9-0a51e8696cad"). InnerVolumeSpecName "kube-api-access-5f8hp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:24.694526 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.694374    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-envoy" pod "bad7c750-19d5-4dfd-b9d9-0a51e8696cad" (UID: "bad7c750-19d5-4dfd-b9d9-0a51e8696cad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.694526 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.694420    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-podinfo" pod "7d1b3a95-dfb1-44d6-9910-3437d0a0e313" (UID: "7d1b3a95-dfb1-44d6-9910-3437d0a0e313"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:24:24.694526 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.694464    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-podinfo" pod "8af4edd7-4096-4c60-bd9f-c24610207d8e" (UID: "8af4edd7-4096-4c60-bd9f-c24610207d8e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:24:24.694526 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.694504    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-podinfo" pod "bad7c750-19d5-4dfd-b9d9-0a51e8696cad" (UID: "bad7c750-19d5-4dfd-b9d9-0a51e8696cad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:24:24.697066 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.697026    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-token" pod "8af4edd7-4096-4c60-bd9f-c24610207d8e" (UID: "8af4edd7-4096-4c60-bd9f-c24610207d8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:24.697066 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.697059    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-token" pod "7d1b3a95-dfb1-44d6-9910-3437d0a0e313" (UID: "7d1b3a95-dfb1-44d6-9910-3437d0a0e313"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:24.697966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.697859    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-token" pod "bad7c750-19d5-4dfd-b9d9-0a51e8696cad" (UID: "bad7c750-19d5-4dfd-b9d9-0a51e8696cad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:24.697966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.697942    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8af4edd7-4096-4c60-bd9f-c24610207d8e-kube-api-access-lbnc5" pod "8af4edd7-4096-4c60-bd9f-c24610207d8e" (UID: "8af4edd7-4096-4c60-bd9f-c24610207d8e"). InnerVolumeSpecName "kube-api-access-lbnc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:24.698701 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.698675    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-envoy" pod "7d1b3a95-dfb1-44d6-9910-3437d0a0e313" (UID: "7d1b3a95-dfb1-44d6-9910-3437d0a0e313"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.700067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.700048    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-envoy" pod "8af4edd7-4096-4c60-bd9f-c24610207d8e" (UID: "8af4edd7-4096-4c60-bd9f-c24610207d8e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.787905    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.787960    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.787976    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.787991    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788023    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788038    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788052    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f8hp\" (UniqueName: \"kubernetes.io/projected/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-kube-api-access-5f8hp\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788069    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788100    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788115    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788128    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788142    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788172    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbnc5\" (UniqueName: \"kubernetes.io/projected/8af4edd7-4096-4c60-bd9f-c24610207d8e-kube-api-access-lbnc5\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788188    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788202    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xnls\" (UniqueName: \"kubernetes.io/projected/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-kube-api-access-4xnls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788215    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8af4edd7-4096-4c60-bd9f-c24610207d8e-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788245    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788260    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788275    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788290    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788304    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788336    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bad7c750-19d5-4dfd-b9d9-0a51e8696cad-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788349    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788363    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788376    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8af4edd7-4096-4c60-bd9f-c24610207d8e-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788410    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8af4edd7-4096-4c60-bd9f-c24610207d8e-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:24.791608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:24.788426    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d1b3a95-dfb1-44d6-9910-3437d0a0e313-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:25.231252 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.231194    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:25.349289 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.349261    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"
Oct 30 22:24:25.349734 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.349301    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2" event={"ID":"bad7c750-19d5-4dfd-b9d9-0a51e8696cad","Type":"ContainerDied","Data":"5c22535876c871ddf4f9774f8e61f1c74203fc1cd65ab7407f273e9d1f9c48f7"}
Oct 30 22:24:25.349734 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.349352    5258 scope.go:122] "RemoveContainer" containerID="81a5e794a61a8be7c9dc18e6f021d8a776424b9e06152b0ea9f03ab0ac47e13a"
Oct 30 22:24:25.351106 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.351077    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"
Oct 30 22:24:25.351106 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.351092    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829" event={"ID":"7d1b3a95-dfb1-44d6-9910-3437d0a0e313","Type":"ContainerDied","Data":"ba0d8362ccb16b2b3eb26598fc7a869b999245264ed910c52c450ae792e45aec"}
Oct 30 22:24:25.353035 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.352997    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"
Oct 30 22:24:25.353035 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.353025    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r" event={"ID":"8af4edd7-4096-4c60-bd9f-c24610207d8e","Type":"ContainerDied","Data":"9f6a8710e1020fae96bcd028094fba144d326c635cb4ce633e4ed933e4d4760e"}
Oct 30 22:24:25.355549 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.355003    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"
Oct 30 22:24:25.355549 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.355538    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf" event={"ID":"e6595215-80bd-4584-8731-fce09ff3905a","Type":"ContainerDied","Data":"71c1f23436afb7ab207e45d4f02a1e24c3b2e3ba33afc131c28e6e7cd9bb58fd"}
Oct 30 22:24:25.364447 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.364342    5258 scope.go:122] "RemoveContainer" containerID="944279adfc7d8b4e23c212250bff02526a010be8f9002bac6a69e62fedc4474b"
Oct 30 22:24:25.377118 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.377097    5258 scope.go:122] "RemoveContainer" containerID="07ff0129421b96b5e450ebc9745960d79fc2b57a22dddb131cc8cf61d850efe3"
Oct 30 22:24:25.389725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.389699    5258 scope.go:122] "RemoveContainer" containerID="7a2a7f8b915008c06188c9dc6a6fa6fd4aa9881dc47c317b08ed7709abe57bb1"
Oct 30 22:24:25.407854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.407829    5258 patch_prober.go:29] interesting pod/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:24:25.407938 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.407877    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf" podUID="e6595215-80bd-4584-8731-fce09ff3905a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:24:25.522034 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.522003    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"]
Oct 30 22:24:25.570780 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.570749    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-866sf"]
Oct 30 22:24:25.608386 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.608358    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:25.706850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.706774    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"]
Oct 30 22:24:25.710836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.710810    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-49c4r"]
Oct 30 22:24:25.822035 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.822008    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"]
Oct 30 22:24:25.826067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.826042    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-hv5r2"]
Oct 30 22:24:25.947082 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.947050    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"]
Oct 30 22:24:25.947734 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:25.947704    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-77cb1f-openshift-default-57f8c95f4c-sh829"]
Oct 30 22:24:27.396290 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:27.396259    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d1b3a95-dfb1-44d6-9910-3437d0a0e313" path="/var/lib/kubelet/pods/7d1b3a95-dfb1-44d6-9910-3437d0a0e313/volumes"
Oct 30 22:24:27.396868 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:27.396852    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8af4edd7-4096-4c60-bd9f-c24610207d8e" path="/var/lib/kubelet/pods/8af4edd7-4096-4c60-bd9f-c24610207d8e/volumes"
Oct 30 22:24:27.397302 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:27.397289    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" path="/var/lib/kubelet/pods/bad7c750-19d5-4dfd-b9d9-0a51e8696cad/volumes"
Oct 30 22:24:27.398072 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:27.398054    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e6595215-80bd-4584-8731-fce09ff3905a" path="/var/lib/kubelet/pods/e6595215-80bd-4584-8731-fce09ff3905a/volumes"
Oct 30 22:24:28.036987 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.036950    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:28.316021 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.315981    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"]
Oct 30 22:24:28.316777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.316753    5258 cpu_manager.go:414] "containerMap: removing container" podUID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerName="istio-proxy"
Oct 30 22:24:28.316777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.316777    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerName="istio-proxy"
Oct 30 22:24:28.316983 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.316796    5258 cpu_manager.go:414] "containerMap: removing container" podUID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerName="istio-proxy"
Oct 30 22:24:28.316983 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.316804    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerName="istio-proxy"
Oct 30 22:24:28.316983 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.316823    5258 cpu_manager.go:414] "containerMap: removing container" podUID="e6595215-80bd-4584-8731-fce09ff3905a" containerName="istio-proxy"
Oct 30 22:24:28.316983 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.316831    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e6595215-80bd-4584-8731-fce09ff3905a" containerName="istio-proxy"
Oct 30 22:24:28.316983 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.316846    5258 cpu_manager.go:414] "containerMap: removing container" podUID="8af4edd7-4096-4c60-bd9f-c24610207d8e" containerName="istio-proxy"
Oct 30 22:24:28.316983 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.316853    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8af4edd7-4096-4c60-bd9f-c24610207d8e" containerName="istio-proxy"
Oct 30 22:24:28.316983 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.316903    5258 cpu_manager.go:414] "containerMap: removing container" podUID="7d1b3a95-dfb1-44d6-9910-3437d0a0e313" containerName="istio-proxy"
Oct 30 22:24:28.316983 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.316910    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d1b3a95-dfb1-44d6-9910-3437d0a0e313" containerName="istio-proxy"
Oct 30 22:24:28.317353 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.317082    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerName="istio-proxy"
Oct 30 22:24:28.317353 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.317098    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="bad7c750-19d5-4dfd-b9d9-0a51e8696cad" containerName="istio-proxy"
Oct 30 22:24:28.317353 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.317109    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="e6595215-80bd-4584-8731-fce09ff3905a" containerName="istio-proxy"
Oct 30 22:24:28.317353 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.317119    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="8af4edd7-4096-4c60-bd9f-c24610207d8e" containerName="istio-proxy"
Oct 30 22:24:28.317353 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.317136    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d1b3a95-dfb1-44d6-9910-3437d0a0e313" containerName="istio-proxy"
Oct 30 22:24:28.322539 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.322518    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.431506 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.431466    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"]
Oct 30 22:24:28.436138 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.436109    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-envoy\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.436294 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.436159    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-token\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.436294 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.436271    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-data\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.436294 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.436289    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-podinfo\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.436468 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.436321    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5rpj\" (UniqueName: \"kubernetes.io/projected/fd5b3786-dca1-47f9-919b-ecfc85009613-kube-api-access-p5rpj\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.436468 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.436399    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-workload-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.436468 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.436433    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd5b3786-dca1-47f9-919b-ecfc85009613-istiod-ca-cert\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.436468 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.436452    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-credential-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.436820 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.436500    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-workload-certs\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.537993 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.537959    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-token\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.538162 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.538049    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-data\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.538162 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.538080    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-podinfo\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.538252 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.538218    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5rpj\" (UniqueName: \"kubernetes.io/projected/fd5b3786-dca1-47f9-919b-ecfc85009613-kube-api-access-p5rpj\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.538297 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.538279    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-workload-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.538369 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.538334    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd5b3786-dca1-47f9-919b-ecfc85009613-istiod-ca-cert\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.538435 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.538391    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-credential-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.538491 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.538471    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-workload-certs\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.538552 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.538517    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-data\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.539004 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.538670    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-workload-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.539004 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.538795    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-envoy\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.539004 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.538843    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-credential-socket\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.539004 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.538958    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-workload-certs\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.539208 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.539077    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd5b3786-dca1-47f9-919b-ecfc85009613-istiod-ca-cert\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.540539 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.540518    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-podinfo\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.540800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.540784    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-envoy\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.599756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.599698    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-token\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.600093 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.600071    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5rpj\" (UniqueName: \"kubernetes.io/projected/fd5b3786-dca1-47f9-919b-ecfc85009613-kube-api-access-p5rpj\") pod \"e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") " pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:28.639707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:28.639682    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:29.101307 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:29.101273    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"]
Oct 30 22:24:29.102414 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:24:29.102380    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5b3786_dca1_47f9_919b_ecfc85009613.slice/crio-0849afb8770cfe4ef2463f5eebcc806c22c8adfd58d5a310126d76a72b657177 WatchSource:0}: Error finding container 0849afb8770cfe4ef2463f5eebcc806c22c8adfd58d5a310126d76a72b657177: Status 404 returned error can't find the container with id 0849afb8770cfe4ef2463f5eebcc806c22c8adfd58d5a310126d76a72b657177
Oct 30 22:24:29.105662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:29.105620    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:24:29.105768 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:29.105713    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:24:29.105768 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:29.105760    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:24:29.236583 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:29.236545    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:29.391420 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:29.391320    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f" event={"ID":"fd5b3786-dca1-47f9-919b-ecfc85009613","Type":"ContainerStarted","Data":"75a583fc9fe51ce70894894d0e6bf2d5a44d77055f2242e8f713b4c990377631"}
Oct 30 22:24:29.391420 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:29.391398    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f" event={"ID":"fd5b3786-dca1-47f9-919b-ecfc85009613","Type":"ContainerStarted","Data":"0849afb8770cfe4ef2463f5eebcc806c22c8adfd58d5a310126d76a72b657177"}
Oct 30 22:24:29.481351 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:29.481266    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:29.569351 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:29.569130    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f" podStartSLOduration=1.569107246 podStartE2EDuration="1.569107246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:24:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:24:29.564773298 +0000 UTC m=+1784.295630443" watchObservedRunningTime="2026-10-30 22:24:29.569107246 +0000 UTC m=+1784.299964392"
Oct 30 22:24:29.640803 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:29.640763    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:30.642692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:30.642659    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 22:24:30.643087 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:30.642712    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f" podUID="fd5b3786-dca1-47f9-919b-ecfc85009613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 22:24:31.640101 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:31.640065    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 22:24:31.640264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:31.640128    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f" podUID="fd5b3786-dca1-47f9-919b-ecfc85009613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 22:24:32.640785 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:32.640752    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 22:24:32.641170 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:32.640817    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f" podUID="fd5b3786-dca1-47f9-919b-ecfc85009613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 22:24:33.647621 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:33.644942    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 22:24:33.647621 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:33.645020    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f" podUID="fd5b3786-dca1-47f9-919b-ecfc85009613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 22:24:33.681702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:33.681666    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:34.640190 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:34.640159    5258 patch_prober.go:29] interesting pod/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 22:24:34.640398 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:34.640227    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f" podUID="fd5b3786-dca1-47f9-919b-ecfc85009613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 22:24:35.673663 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:35.673631    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:35.674875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:35.674682    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:35.678973 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:35.678950    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:24:38.682627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:38.682551    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:43.162799 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:24:43.162764    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:24:43.732885 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:43.732841    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:45.659408 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:45.659378    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:24:45.662840 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:45.662814    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:24:45.900472 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:45.900432    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:46.500227 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.500185    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"]
Oct 30 22:24:46.508248 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.508216    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.563793 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.563762    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a42692-openshift-default-dockercfg-hwlrx\""
Oct 30 22:24:46.576004 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.575968    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-token\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.576245 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.576225    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-envoy\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.576471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.576451    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4139bcb-54a6-415d-961b-06d54e1894bc-istiod-ca-cert\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.576681 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.576662    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfhmj\" (UniqueName: \"kubernetes.io/projected/e4139bcb-54a6-415d-961b-06d54e1894bc-kube-api-access-vfhmj\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.576837 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.576821    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-workload-socket\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.577043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.577027    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-podinfo\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.577198 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.577182    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-workload-certs\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.577301 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.577287    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-data\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.577431 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.577416    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-credential-socket\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.639677 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.635247    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"]
Oct 30 22:24:46.717122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.711510    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-token\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.717122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.711609    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-envoy\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.717122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.711711    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4139bcb-54a6-415d-961b-06d54e1894bc-istiod-ca-cert\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.717122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.711805    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfhmj\" (UniqueName: \"kubernetes.io/projected/e4139bcb-54a6-415d-961b-06d54e1894bc-kube-api-access-vfhmj\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.717122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.711867    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-workload-socket\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.717122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.712007    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-podinfo\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.717122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.712091    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-workload-certs\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.717122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.712115    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-data\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.717122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.712176    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-credential-socket\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.717122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.712903    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-credential-socket\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.718151 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.717485    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-workload-socket\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.718917 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.718891    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4139bcb-54a6-415d-961b-06d54e1894bc-istiod-ca-cert\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.722839 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.719679    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:46.722839 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.720673    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-workload-certs\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.722839 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.720880    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-data\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.722839 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.723529    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-podinfo\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.722839 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.725798    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-envoy\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.789655 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.783372    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfhmj\" (UniqueName: \"kubernetes.io/projected/e4139bcb-54a6-415d-961b-06d54e1894bc-kube-api-access-vfhmj\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.803726 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.797572    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-token\") pod \"e2e-api-a-a42692-openshift-default-5898797997-vsb6m\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") " pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:46.892338 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:46.892302    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:47.353649 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:47.353617    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"]
Oct 30 22:24:47.354166 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:24:47.354143    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4139bcb_54a6_415d_961b_06d54e1894bc.slice/crio-70381ff3b5cfd154d817a9a10c0934f92fe8922347988baddb90fd4f1ac26657 WatchSource:0}: Error finding container 70381ff3b5cfd154d817a9a10c0934f92fe8922347988baddb90fd4f1ac26657: Status 404 returned error can't find the container with id 70381ff3b5cfd154d817a9a10c0934f92fe8922347988baddb90fd4f1ac26657
Oct 30 22:24:47.357663 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:47.357625    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:24:47.357773 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:47.357709    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:24:47.357773 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:47.357753    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:24:47.443622 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:47.443343    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:47.636996 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:47.635449    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m" event={"ID":"e4139bcb-54a6-415d-961b-06d54e1894bc","Type":"ContainerStarted","Data":"0f396fa880c8a55ba0f1fd62d95b7dcf4408ab505c8211cdcb0b5e52acb6c052"}
Oct 30 22:24:47.636996 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:47.635521    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m" event={"ID":"e4139bcb-54a6-415d-961b-06d54e1894bc","Type":"ContainerStarted","Data":"70381ff3b5cfd154d817a9a10c0934f92fe8922347988baddb90fd4f1ac26657"}
Oct 30 22:24:47.766864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:47.766805    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m" podStartSLOduration=1.766789505 podStartE2EDuration="1.766789505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:24:47.761185651 +0000 UTC m=+1802.492042794" watchObservedRunningTime="2026-10-30 22:24:47.766789505 +0000 UTC m=+1802.497646647"
Oct 30 22:24:47.787311 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:47.787264    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:24:47.900665 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:47.897690    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:48.898316 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:48.898286    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:48.995656 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:48.995616    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:49.651019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:49.650990    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:49.651796 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:49.651779    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:24:51.231532 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:51.231499    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:51.473998 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:51.473969    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:54.125040 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.125004    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"]
Oct 30 22:24:54.130654 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.130631    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:54.156409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.156383    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:54.156566 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.156541    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:54.156707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.156686    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nslbh\" (UniqueName: \"kubernetes.io/projected/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-kube-api-access-nslbh\") pod \"maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:54.156755 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.156722    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:54.235132 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.235099    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w0-8e1227-serving-cert\""
Oct 30 22:24:54.241068 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.241035    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"]
Oct 30 22:24:54.258643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.258610    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nslbh\" (UniqueName: \"kubernetes.io/projected/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-kube-api-access-nslbh\") pod \"maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:54.258808 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.258669    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:54.258899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.258880    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:54.260135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.259257    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:54.260135 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:24:54.259300    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-serving-cert: secret "maas-api-e2e-shared-a-w0-8e1227-serving-cert" not found
Oct 30 22:24:54.260135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.259698    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:54.260135 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:24:54.259731    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-maas-api-tls podName:285e9bb2-0d1c-48c4-a48d-48d2f3b2aace nodeName:}" failed. No retries permitted until 2026-10-30 22:24:54.759708891 +0000 UTC m=+1809.490566025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-maas-api-tls") pod "maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f" (UID: "285e9bb2-0d1c-48c4-a48d-48d2f3b2aace") : secret "maas-api-e2e-shared-a-w0-8e1227-serving-cert" not found
Oct 30 22:24:54.261953 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.261930    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:54.323231 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.323201    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nslbh\" (UniqueName: \"kubernetes.io/projected/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-kube-api-access-nslbh\") pod \"maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:54.366577 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.366534    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:54.628613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.626289    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:54.772014 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.771978    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:54.774679 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.774646    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:54.853716 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:54.853673    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:55.047040 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:55.046944    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:55.486518 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:55.486484    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"]
Oct 30 22:24:55.487137 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:24:55.487115    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285e9bb2_0d1c_48c4_a48d_48d2f3b2aace.slice/crio-25bbccb9de3deb2a5592544b62870527a26ad769523d79e90d2e495ea0106942 WatchSource:0}: Error finding container 25bbccb9de3deb2a5592544b62870527a26ad769523d79e90d2e495ea0106942: Status 404 returned error can't find the container with id 25bbccb9de3deb2a5592544b62870527a26ad769523d79e90d2e495ea0106942
Oct 30 22:24:55.771260 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:55.771154    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f" event={"ID":"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace","Type":"ContainerStarted","Data":"25bbccb9de3deb2a5592544b62870527a26ad769523d79e90d2e495ea0106942"}
Oct 30 22:24:56.781979 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:56.781880    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f" event={"ID":"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace","Type":"ContainerStarted","Data":"a0140a4d5e305ba97cdcd970e0ffc82d7a380cad0384c8863844231326f3c972"}
Oct 30 22:24:56.782414 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:56.781987    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:24:56.906024 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:24:56.905969    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f" podStartSLOduration=2.08553386 podStartE2EDuration="2.905953886s" totalImagesPullingTime="820.420026ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:24:56.903033919 +0000 UTC m=+1811.633891063" watchObservedRunningTime="2026-10-30 22:24:56.905953886 +0000 UTC m=+1811.636811028"
Oct 30 22:25:00.562603 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:00.559690    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:02.797828 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:02.797798    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:25:06.684885 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:06.684845    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:11.830299 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:11.830262    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:13.204427 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:25:13.204371    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:25:16.646145 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.646111    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"]
Oct 30 22:25:16.671164 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.671135    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:16.720246 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.720216    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"]
Oct 30 22:25:16.740639 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.740603    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:16.740961 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.740934    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2j4m\" (UniqueName: \"kubernetes.io/projected/a64e5054-857f-4eb2-9180-a547caf0ad09-kube-api-access-v2j4m\") pod \"maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:16.741305 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.741283    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a64e5054-857f-4eb2-9180-a547caf0ad09-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:16.741480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.741461    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:16.775540 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.774815    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w6-6c7d3f-serving-cert\""
Oct 30 22:25:16.843089 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.843053    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:16.843249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.843171    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:16.843298 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.843259    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2j4m\" (UniqueName: \"kubernetes.io/projected/a64e5054-857f-4eb2-9180-a547caf0ad09-kube-api-access-v2j4m\") pod \"maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:16.843457 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.843438    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a64e5054-857f-4eb2-9180-a547caf0ad09-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:16.843932 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:25:16.843910    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-serving-cert: secret "maas-api-e2e-shared-b-w6-6c7d3f-serving-cert" not found
Oct 30 22:25:16.844032 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:25:16.843980    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-maas-api-tls podName:a64e5054-857f-4eb2-9180-a547caf0ad09 nodeName:}" failed. No retries permitted until 2026-10-30 22:25:17.343963867 +0000 UTC m=+1832.074821002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-maas-api-tls") pod "maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh" (UID: "a64e5054-857f-4eb2-9180-a547caf0ad09") : secret "maas-api-e2e-shared-b-w6-6c7d3f-serving-cert" not found
Oct 30 22:25:16.844220 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.844197    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a64e5054-857f-4eb2-9180-a547caf0ad09-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:16.846622 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.845798    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:16.924376 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.924031    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2j4m\" (UniqueName: \"kubernetes.io/projected/a64e5054-857f-4eb2-9180-a547caf0ad09-kube-api-access-v2j4m\") pod \"maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:16.999407 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:16.999299    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:17.240549 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:17.240452    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:17.350384 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:17.350346    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:17.382615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:17.373239    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:17.482916 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:17.482878    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:17.594819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:17.594778    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:18.027625 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:18.027528    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"]
Oct 30 22:25:18.030755 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:25:18.030726    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64e5054_857f_4eb2_9180_a547caf0ad09.slice/crio-61d4f662c138f7a710f4e01fb3ed02c27f773d1656fc57fefe6c38bf6ae2a99c WatchSource:0}: Error finding container 61d4f662c138f7a710f4e01fb3ed02c27f773d1656fc57fefe6c38bf6ae2a99c: Status 404 returned error can't find the container with id 61d4f662c138f7a710f4e01fb3ed02c27f773d1656fc57fefe6c38bf6ae2a99c
Oct 30 22:25:19.033840 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:19.033768    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh" event={"ID":"a64e5054-857f-4eb2-9180-a547caf0ad09","Type":"ContainerStarted","Data":"61d4f662c138f7a710f4e01fb3ed02c27f773d1656fc57fefe6c38bf6ae2a99c"}
Oct 30 22:25:20.080621 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:20.078429    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh" event={"ID":"a64e5054-857f-4eb2-9180-a547caf0ad09","Type":"ContainerStarted","Data":"a94d0a72dd2017e2b6cbeae4d163696bd02ba3092d916d0c384446dc1f2a08d7"}
Oct 30 22:25:20.080621 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:20.078890    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:20.205461 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:20.205399    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh" podStartSLOduration=3.303966833 podStartE2EDuration="4.205381278s" totalImagesPullingTime="901.414445ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:25:20.203177154 +0000 UTC m=+1834.934034295" watchObservedRunningTime="2026-10-30 22:25:20.205381278 +0000 UTC m=+1834.936238422"
Oct 30 22:25:22.398614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:22.397724    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:24.122651 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:24.122583    5258 generic.go:356] "Generic (PLEG): container finished" podID="bdc948e1-3516-469d-a39f-8531663ea68c" containerID="d5eeb1f867c442973dd217d6460bd719fe0c95e91bb68926db53046b60ee7fac" exitCode=0
Oct 30 22:25:24.123467 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:24.122848    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc" event={"ID":"bdc948e1-3516-469d-a39f-8531663ea68c","Type":"ContainerDied","Data":"d5eeb1f867c442973dd217d6460bd719fe0c95e91bb68926db53046b60ee7fac"}
Oct 30 22:25:24.123467 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:24.123391    5258 scope.go:122] "RemoveContainer" containerID="d5eeb1f867c442973dd217d6460bd719fe0c95e91bb68926db53046b60ee7fac"
Oct 30 22:25:24.126881 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:24.126839    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:25:24.127027 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:24.127005    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:25:24.127137 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:24.127119    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:25:25.133103 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:25.133071    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc" event={"ID":"bdc948e1-3516-469d-a39f-8531663ea68c","Type":"ContainerStarted","Data":"feb702b3abbbe0513faf0c3a7aba2bcba9e22988a664ad31c96e76caed10a14b"}
Oct 30 22:25:25.314149 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:25.314111    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:25:25.315753 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:25.315715    5258 patch_prober.go:29] interesting pod/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 30 22:25:25.315892 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:25.315772    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc" podUID="bdc948e1-3516-469d-a39f-8531663ea68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 30 22:25:25.932558 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:25.932520    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:26.092961 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:26.092930    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:25:26.314802 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:26.314765    5258 patch_prober.go:29] interesting pod/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 30 22:25:26.315411 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:26.315378    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc" podUID="bdc948e1-3516-469d-a39f-8531663ea68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 30 22:25:27.314846 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.314808    5258 patch_prober.go:29] interesting pod/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 30 22:25:27.315245 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.314861    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc" podUID="bdc948e1-3516-469d-a39f-8531663ea68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 30 22:25:27.485133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.485099    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"]
Oct 30 22:25:27.489926 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.489902    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:27.526413 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.526384    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"]
Oct 30 22:25:27.543440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.543403    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w5-53cceb-serving-cert\""
Oct 30 22:25:27.628151 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.628068    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a7449a-31c0-4974-b474-914075734486-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:27.628389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.628363    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:27.628494 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.628474    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-metrics-certs\") pod \"maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:27.628557 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.628528    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dpxp\" (UniqueName: \"kubernetes.io/projected/b7a7449a-31c0-4974-b474-914075734486-kube-api-access-7dpxp\") pod \"maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:27.734484 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.734257    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:27.734484 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.734383    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-metrics-certs\") pod \"maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:27.734484 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.734421    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dpxp\" (UniqueName: \"kubernetes.io/projected/b7a7449a-31c0-4974-b474-914075734486-kube-api-access-7dpxp\") pod \"maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:27.734839 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.734560    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a7449a-31c0-4974-b474-914075734486-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:27.738611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.735532    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a7449a-31c0-4974-b474-914075734486-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:27.738611 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:25:27.735673    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-serving-cert: secret "maas-api-e2e-shared-a-w5-53cceb-serving-cert" not found
Oct 30 22:25:27.738611 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:25:27.735751    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-maas-api-tls podName:b7a7449a-31c0-4974-b474-914075734486 nodeName:}" failed. No retries permitted until 2026-10-30 22:25:28.235731652 +0000 UTC m=+1842.966588774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-maas-api-tls") pod "maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822" (UID: "b7a7449a-31c0-4974-b474-914075734486") : secret "maas-api-e2e-shared-a-w5-53cceb-serving-cert" not found
Oct 30 22:25:27.805613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.791508    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-metrics-certs\") pod \"maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:27.805613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.795053    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:27.829612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:27.823746    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dpxp\" (UniqueName: \"kubernetes.io/projected/b7a7449a-31c0-4974-b474-914075734486-kube-api-access-7dpxp\") pod \"maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:28.022058 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:28.021967    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:28.244944 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:28.244905    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:28.247323 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:28.247296    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-maas-api-tls\") pod \"maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:28.314849 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:28.314814    5258 patch_prober.go:29] interesting pod/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 30 22:25:28.315010 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:28.314893    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc" podUID="bdc948e1-3516-469d-a39f-8531663ea68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 30 22:25:28.404080 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:28.404049    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:28.705908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:28.705829    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:25:28.828402 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:28.828370    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"]
Oct 30 22:25:28.829849 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:25:28.829818    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a7449a_31c0_4974_b474_914075734486.slice/crio-1574f01947e7c6d6f3df783a40562b1f1f261e6a04bda346d92c2da4b1de5394 WatchSource:0}: Error finding container 1574f01947e7c6d6f3df783a40562b1f1f261e6a04bda346d92c2da4b1de5394: Status 404 returned error can't find the container with id 1574f01947e7c6d6f3df783a40562b1f1f261e6a04bda346d92c2da4b1de5394
Oct 30 22:25:29.196925 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:29.196877    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822" event={"ID":"b7a7449a-31c0-4974-b474-914075734486","Type":"ContainerStarted","Data":"1574f01947e7c6d6f3df783a40562b1f1f261e6a04bda346d92c2da4b1de5394"}
Oct 30 22:25:29.314384 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:29.314345    5258 patch_prober.go:29] interesting pod/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 30 22:25:29.314551 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:29.314420    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc" podUID="bdc948e1-3516-469d-a39f-8531663ea68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 30 22:25:29.917154 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:29.917056    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:30.207083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:30.206989    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822" event={"ID":"b7a7449a-31c0-4974-b474-914075734486","Type":"ContainerStarted","Data":"18ad80456c04b18826388687b185d15501655932591927b9a7892327e68f35f7"}
Oct 30 22:25:30.207083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:30.207072    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:30.314951 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:30.314916    5258 patch_prober.go:29] interesting pod/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 30 22:25:30.315138 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:30.314965    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc" podUID="bdc948e1-3516-469d-a39f-8531663ea68c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 30 22:25:30.345907 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:30.345850    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822" podStartSLOduration=2.534749074 podStartE2EDuration="3.345837388s" totalImagesPullingTime="811.088314ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:25:30.343002196 +0000 UTC m=+1845.073859339" watchObservedRunningTime="2026-10-30 22:25:30.345837388 +0000 UTC m=+1845.076694576"
Oct 30 22:25:31.318933 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:31.318901    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:25:31.320092 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:31.320068    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:25:33.747533 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:33.747489    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:34.918186 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:34.918148    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:36.220936 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:36.220905    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:25:39.459639 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:39.459582    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:40.155177 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:40.155140    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:43.163971 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:25:43.163931    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:25:45.083619 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:45.083564    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:48.701691 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:48.701657    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"]
Oct 30 22:25:49.038363 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:49.038273    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:49.282281 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:49.282245    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:50.547480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.547438    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"]
Oct 30 22:25:50.586341 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.575847    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:50.622460 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.622416    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"]
Oct 30 22:25:50.657535 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.657507    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-afe802-serving-cert\""
Oct 30 22:25:50.685389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.685353    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:50.685996 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.685954    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:50.686303 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.686283    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4wpz\" (UniqueName: \"kubernetes.io/projected/8e656e61-b054-463d-be01-3f1fa44ebfe1-kube-api-access-v4wpz\") pod \"maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:50.686461 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.686447    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e656e61-b054-463d-be01-3f1fa44ebfe1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:50.788046 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.788006    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:50.788246 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.788141    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4wpz\" (UniqueName: \"kubernetes.io/projected/8e656e61-b054-463d-be01-3f1fa44ebfe1-kube-api-access-v4wpz\") pod \"maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:50.788246 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:25:50.788161    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-serving-cert: secret "maas-api-e2e-shared-b-w2-afe802-serving-cert" not found
Oct 30 22:25:50.788363 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:25:50.788257    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-maas-api-tls podName:8e656e61-b054-463d-be01-3f1fa44ebfe1 nodeName:}" failed. No retries permitted until 2026-10-30 22:25:51.288236961 +0000 UTC m=+1866.019094095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-maas-api-tls") pod "maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6" (UID: "8e656e61-b054-463d-be01-3f1fa44ebfe1") : secret "maas-api-e2e-shared-b-w2-afe802-serving-cert" not found
Oct 30 22:25:50.788363 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.788180    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e656e61-b054-463d-be01-3f1fa44ebfe1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:50.788455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.788435    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:50.788936 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.788905    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e656e61-b054-463d-be01-3f1fa44ebfe1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:50.791351 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.791302    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:50.823828 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.823652    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:50.852189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:50.852150    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4wpz\" (UniqueName: \"kubernetes.io/projected/8e656e61-b054-463d-be01-3f1fa44ebfe1-kube-api-access-v4wpz\") pod \"maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:51.046114 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:51.046068    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:51.268292 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:51.268204    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:51.301606 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:51.301568    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:51.303991 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:51.303970    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:51.511232 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:51.511192    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:51.901918 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:25:51.901886    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e656e61_b054_463d_be01_3f1fa44ebfe1.slice/crio-0c5c3bd74fea64f237dabc4588a401cf941f937e39fc84f1988ff87dcb38a391 WatchSource:0}: Error finding container 0c5c3bd74fea64f237dabc4588a401cf941f937e39fc84f1988ff87dcb38a391: Status 404 returned error can't find the container with id 0c5c3bd74fea64f237dabc4588a401cf941f937e39fc84f1988ff87dcb38a391
Oct 30 22:25:51.903471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:51.903442    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"]
Oct 30 22:25:52.525054 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:52.525020    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6" event={"ID":"8e656e61-b054-463d-be01-3f1fa44ebfe1","Type":"ContainerStarted","Data":"0c5c3bd74fea64f237dabc4588a401cf941f937e39fc84f1988ff87dcb38a391"}
Oct 30 22:25:53.251284 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:53.251246    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:25:53.537673 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:53.537551    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6" event={"ID":"8e656e61-b054-463d-be01-3f1fa44ebfe1","Type":"ContainerStarted","Data":"b90bedded5276418fa0a7b875e3766b2a7d714e727ad79ce22cbed9892a30ad5"}
Oct 30 22:25:53.537673 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:53.537638    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:25:53.658767 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:53.658703    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6" podStartSLOduration=2.842048418 podStartE2EDuration="3.65867793s" totalImagesPullingTime="816.629512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:25:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:25:53.657908761 +0000 UTC m=+1868.388765904" watchObservedRunningTime="2026-10-30 22:25:53.65867793 +0000 UTC m=+1868.389535079"
Oct 30 22:25:53.703281 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:53.703218    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9" podUID="9dd33760-037c-41b0-848d-50c297665fd8" containerName="payload-pre-processing" containerID="cri-o://e25e0859f60178138825f64f53144744a8a702f6b55f3e637e1d5c611bef0f06" gracePeriod=25
Oct 30 22:25:54.633013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:54.628760    5258 generic.go:356] "Generic (PLEG): container finished" podID="9dd33760-037c-41b0-848d-50c297665fd8" containerID="e25e0859f60178138825f64f53144744a8a702f6b55f3e637e1d5c611bef0f06" exitCode=0
Oct 30 22:25:54.633013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:54.628851    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9" event={"ID":"9dd33760-037c-41b0-848d-50c297665fd8","Type":"ContainerDied","Data":"e25e0859f60178138825f64f53144744a8a702f6b55f3e637e1d5c611bef0f06"}
Oct 30 22:25:54.660385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:54.660345    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"
Oct 30 22:25:54.776179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:54.776133    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9dd33760-037c-41b0-848d-50c297665fd8-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dd33760-037c-41b0-848d-50c297665fd8-plugins-config-volume\") pod \"9dd33760-037c-41b0-848d-50c297665fd8\" (UID: \"9dd33760-037c-41b0-848d-50c297665fd8\") "
Oct 30 22:25:54.776476 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:54.776445    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9dd33760-037c-41b0-848d-50c297665fd8-kube-api-access-njjqf\" (UniqueName: \"kubernetes.io/projected/9dd33760-037c-41b0-848d-50c297665fd8-kube-api-access-njjqf\") pod \"9dd33760-037c-41b0-848d-50c297665fd8\" (UID: \"9dd33760-037c-41b0-848d-50c297665fd8\") "
Oct 30 22:25:54.776834 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:54.776486    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dd33760-037c-41b0-848d-50c297665fd8-plugins-config-volume" pod "9dd33760-037c-41b0-848d-50c297665fd8" (UID: "9dd33760-037c-41b0-848d-50c297665fd8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:54.777772 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:54.777749    5258 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dd33760-037c-41b0-848d-50c297665fd8-plugins-config-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:54.781450 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:54.781415    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd33760-037c-41b0-848d-50c297665fd8-kube-api-access-njjqf" pod "9dd33760-037c-41b0-848d-50c297665fd8" (UID: "9dd33760-037c-41b0-848d-50c297665fd8"). InnerVolumeSpecName "kube-api-access-njjqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:54.880229 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:54.880182    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njjqf\" (UniqueName: \"kubernetes.io/projected/9dd33760-037c-41b0-848d-50c297665fd8-kube-api-access-njjqf\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:55.638659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:55.638632    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"
Oct 30 22:25:55.638659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:55.638640    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9" event={"ID":"9dd33760-037c-41b0-848d-50c297665fd8","Type":"ContainerDied","Data":"aaf8866b5a466555b9893dce5b1edcf5fd5b09c089ff4d744f4751684ac95afb"}
Oct 30 22:25:55.639157 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:55.638705    5258 scope.go:122] "RemoveContainer" containerID="e25e0859f60178138825f64f53144744a8a702f6b55f3e637e1d5c611bef0f06"
Oct 30 22:25:55.808389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:55.808356    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"]
Oct 30 22:25:55.882361 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:55.882321    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-367f4491-5d56bc74d7-n5kx9"]
Oct 30 22:25:56.674011 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:56.673975    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:57.390013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:57.389976    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9dd33760-037c-41b0-848d-50c297665fd8" path="/var/lib/kubelet/pods/9dd33760-037c-41b0-848d-50c297665fd8/volumes"
Oct 30 22:25:59.637082 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:25:59.637054    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:26:01.789398 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:01.789300    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:04.812017 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:04.811986    5258 generic.go:356] "Generic (PLEG): container finished" podID="878e5b5e-2d16-4105-9646-98904fcce19c" containerID="477eb3cd6be55dd5daa2ce9c8c151003b2095c03605dfe91a50e929f426afd33" exitCode=0
Oct 30 22:26:04.812461 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:04.812057    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6" event={"ID":"878e5b5e-2d16-4105-9646-98904fcce19c","Type":"ContainerDied","Data":"477eb3cd6be55dd5daa2ce9c8c151003b2095c03605dfe91a50e929f426afd33"}
Oct 30 22:26:04.812533 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:04.812495    5258 scope.go:122] "RemoveContainer" containerID="477eb3cd6be55dd5daa2ce9c8c151003b2095c03605dfe91a50e929f426afd33"
Oct 30 22:26:04.814179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:04.814152    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:26:04.814245 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:04.814221    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:26:04.814281 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:04.814253    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:26:05.822076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:05.822046    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6" event={"ID":"878e5b5e-2d16-4105-9646-98904fcce19c","Type":"ContainerStarted","Data":"c50519552fa071a24de90922e36a0acda65ca02c0da39ce7049f4b2ae4f283b0"}
Oct 30 22:26:06.484491 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:06.484074    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:26:06.485618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:06.484828    5258 patch_prober.go:29] interesting pod/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Oct 30 22:26:06.485618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:06.484899    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6" podUID="878e5b5e-2d16-4105-9646-98904fcce19c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Oct 30 22:26:06.905614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:06.902468    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:07.484956 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:07.484916    5258 patch_prober.go:29] interesting pod/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Oct 30 22:26:07.485174 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:07.484984    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6" podUID="878e5b5e-2d16-4105-9646-98904fcce19c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Oct 30 22:26:08.072982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:08.072944    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:26:08.482721 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:08.482218    5258 patch_prober.go:29] interesting pod/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Oct 30 22:26:08.482721 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:08.482285    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6" podUID="878e5b5e-2d16-4105-9646-98904fcce19c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Oct 30 22:26:09.481611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:09.481543    5258 patch_prober.go:29] interesting pod/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Oct 30 22:26:09.482084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:09.481619    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6" podUID="878e5b5e-2d16-4105-9646-98904fcce19c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Oct 30 22:26:10.483284 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:10.483000    5258 patch_prober.go:29] interesting pod/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Oct 30 22:26:10.483284 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:10.483066    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6" podUID="878e5b5e-2d16-4105-9646-98904fcce19c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Oct 30 22:26:11.482612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:11.481942    5258 patch_prober.go:29] interesting pod/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused" start-of-body=
Oct 30 22:26:11.482612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:11.482001    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6" podUID="878e5b5e-2d16-4105-9646-98904fcce19c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.120:15021/healthz/ready\": dial tcp 10.132.0.120:15021: connect: connection refused"
Oct 30 22:26:12.043944 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:12.043904    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:12.485625 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:12.485555    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:26:12.486764 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:12.486738    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:26:13.165772 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:26:13.165728    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:26:17.123808 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:17.123770    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:17.415925 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:17.415840    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:22.511093 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:22.511006    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:23.868358 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:23.868326    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"]
Oct 30 22:26:23.868805 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:23.868544    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr" podUID="483ce3ac-7be5-43be-ab91-6b26d13f9f80" containerName="istio-proxy" containerID="cri-o://d1d0187c77eb4fa2953cf9f522cc2db0f76c89da21138e34d2e8b593fe3d41c6" gracePeriod=30
Oct 30 22:26:23.917756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:23.917717    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"]
Oct 30 22:26:23.917960 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:23.917922    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw" podUID="0c2299dc-d499-44f2-ba4f-710d84de4bed" containerName="istio-proxy" containerID="cri-o://bb0330d465eacaead77e7112848773f80836c19ed9d892e2eb134d51d501b6a1" gracePeriod=30
Oct 30 22:26:24.545929 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:24.545884    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:26:24.546105 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:24.545953    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw" podUID="0c2299dc-d499-44f2-ba4f-710d84de4bed" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:26:26.266216 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:26.266089    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:26.525409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:26.525307    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:27.696049 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:27.696013    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:28.510392 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:28.510359    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:26:28.510610 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:28.510412    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr" podUID="483ce3ac-7be5-43be-ab91-6b26d13f9f80" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:26:29.058200 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.058160    5258 generic.go:356] "Generic (PLEG): container finished" podID="0c2299dc-d499-44f2-ba4f-710d84de4bed" containerID="bb0330d465eacaead77e7112848773f80836c19ed9d892e2eb134d51d501b6a1" exitCode=0
Oct 30 22:26:29.063839 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.063803    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw" event={"ID":"0c2299dc-d499-44f2-ba4f-710d84de4bed","Type":"ContainerDied","Data":"bb0330d465eacaead77e7112848773f80836c19ed9d892e2eb134d51d501b6a1"}
Oct 30 22:26:29.066894 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.066857    5258 generic.go:356] "Generic (PLEG): container finished" podID="483ce3ac-7be5-43be-ab91-6b26d13f9f80" containerID="d1d0187c77eb4fa2953cf9f522cc2db0f76c89da21138e34d2e8b593fe3d41c6" exitCode=0
Oct 30 22:26:29.067208 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.067077    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr" event={"ID":"483ce3ac-7be5-43be-ab91-6b26d13f9f80","Type":"ContainerDied","Data":"d1d0187c77eb4fa2953cf9f522cc2db0f76c89da21138e34d2e8b593fe3d41c6"}
Oct 30 22:26:29.243922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.243891    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:26:29.305474 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.305446    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:26:29.341410 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.341377    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-workload-socket\") pod \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") "
Oct 30 22:26:29.341582 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.341418    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-token\" (UniqueName: \"kubernetes.io/projected/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-token\") pod \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") "
Oct 30 22:26:29.341582 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.341448    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-credential-socket\") pod \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") "
Oct 30 22:26:29.341582 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.341507    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-data\") pod \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") "
Oct 30 22:26:29.341809 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.341579    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-workload-certs\") pod \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") "
Oct 30 22:26:29.341809 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.341721    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istiod-ca-cert\") pod \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") "
Oct 30 22:26:29.341809 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.341731    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-workload-socket" pod "483ce3ac-7be5-43be-ab91-6b26d13f9f80" (UID: "483ce3ac-7be5-43be-ab91-6b26d13f9f80"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.341809 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.341798    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-podinfo\") pod \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") "
Oct 30 22:26:29.342033 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.341860    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/483ce3ac-7be5-43be-ab91-6b26d13f9f80-kube-api-access-bmggn\" (UniqueName: \"kubernetes.io/projected/483ce3ac-7be5-43be-ab91-6b26d13f9f80-kube-api-access-bmggn\") pod \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") "
Oct 30 22:26:29.342033 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.341894    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-credential-socket" pod "483ce3ac-7be5-43be-ab91-6b26d13f9f80" (UID: "483ce3ac-7be5-43be-ab91-6b26d13f9f80"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.342033 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.341911    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-workload-certs" pod "483ce3ac-7be5-43be-ab91-6b26d13f9f80" (UID: "483ce3ac-7be5-43be-ab91-6b26d13f9f80"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.342033 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.341934    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-data" pod "483ce3ac-7be5-43be-ab91-6b26d13f9f80" (UID: "483ce3ac-7be5-43be-ab91-6b26d13f9f80"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.342259 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.342075    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-envoy\") pod \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\" (UID: \"483ce3ac-7be5-43be-ab91-6b26d13f9f80\") "
Oct 30 22:26:29.342259 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.342102    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istiod-ca-cert" pod "483ce3ac-7be5-43be-ab91-6b26d13f9f80" (UID: "483ce3ac-7be5-43be-ab91-6b26d13f9f80"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:29.342966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.342927    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.342966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.342960    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.343205 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.342978    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.343205 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.342992    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.343205 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.343008    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.344127 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.344103    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-podinfo" pod "483ce3ac-7be5-43be-ab91-6b26d13f9f80" (UID: "483ce3ac-7be5-43be-ab91-6b26d13f9f80"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:26:29.344219 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.344144    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/483ce3ac-7be5-43be-ab91-6b26d13f9f80-kube-api-access-bmggn" pod "483ce3ac-7be5-43be-ab91-6b26d13f9f80" (UID: "483ce3ac-7be5-43be-ab91-6b26d13f9f80"). InnerVolumeSpecName "kube-api-access-bmggn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:29.344219 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.344181    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-token" pod "483ce3ac-7be5-43be-ab91-6b26d13f9f80" (UID: "483ce3ac-7be5-43be-ab91-6b26d13f9f80"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:29.344337 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.344229    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-envoy" pod "483ce3ac-7be5-43be-ab91-6b26d13f9f80" (UID: "483ce3ac-7be5-43be-ab91-6b26d13f9f80"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.443668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.443554    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-podinfo\") pod \"0c2299dc-d499-44f2-ba4f-710d84de4bed\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") "
Oct 30 22:26:29.443668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.443622    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-token\" (UniqueName: \"kubernetes.io/projected/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-token\") pod \"0c2299dc-d499-44f2-ba4f-710d84de4bed\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") "
Oct 30 22:26:29.444120 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.444085    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-credential-socket\") pod \"0c2299dc-d499-44f2-ba4f-710d84de4bed\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") "
Oct 30 22:26:29.444252 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.444180    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-data\") pod \"0c2299dc-d499-44f2-ba4f-710d84de4bed\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") "
Oct 30 22:26:29.444386 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.444367    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-workload-certs\") pod \"0c2299dc-d499-44f2-ba4f-710d84de4bed\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") "
Oct 30 22:26:29.444515 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.444405    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-credential-socket" pod "0c2299dc-d499-44f2-ba4f-710d84de4bed" (UID: "0c2299dc-d499-44f2-ba4f-710d84de4bed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.444515 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.444457    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-workload-socket\") pod \"0c2299dc-d499-44f2-ba4f-710d84de4bed\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") "
Oct 30 22:26:29.444515 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.444507    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-envoy\") pod \"0c2299dc-d499-44f2-ba4f-710d84de4bed\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") "
Oct 30 22:26:29.444731 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.444667    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-data" pod "0c2299dc-d499-44f2-ba4f-710d84de4bed" (UID: "0c2299dc-d499-44f2-ba4f-710d84de4bed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.444787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.444744    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0c2299dc-d499-44f2-ba4f-710d84de4bed-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c2299dc-d499-44f2-ba4f-710d84de4bed-istiod-ca-cert\") pod \"0c2299dc-d499-44f2-ba4f-710d84de4bed\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") "
Oct 30 22:26:29.444840 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.444809    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c2299dc-d499-44f2-ba4f-710d84de4bed-kube-api-access-p8qb2\" (UniqueName: \"kubernetes.io/projected/0c2299dc-d499-44f2-ba4f-710d84de4bed-kube-api-access-p8qb2\") pod \"0c2299dc-d499-44f2-ba4f-710d84de4bed\" (UID: \"0c2299dc-d499-44f2-ba4f-710d84de4bed\") "
Oct 30 22:26:29.445047 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.445018    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-workload-socket" pod "0c2299dc-d499-44f2-ba4f-710d84de4bed" (UID: "0c2299dc-d499-44f2-ba4f-710d84de4bed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.445313 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.445290    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-workload-certs" pod "0c2299dc-d499-44f2-ba4f-710d84de4bed" (UID: "0c2299dc-d499-44f2-ba4f-710d84de4bed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.445632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.445608    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.445723 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.445645    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.445723 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.445661    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmggn\" (UniqueName: \"kubernetes.io/projected/483ce3ac-7be5-43be-ab91-6b26d13f9f80-kube-api-access-bmggn\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.445723 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.445676    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.445723 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.445606    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c2299dc-d499-44f2-ba4f-710d84de4bed-istiod-ca-cert" pod "0c2299dc-d499-44f2-ba4f-710d84de4bed" (UID: "0c2299dc-d499-44f2-ba4f-710d84de4bed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:29.445723 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.445691    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.445954 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.445735    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/483ce3ac-7be5-43be-ab91-6b26d13f9f80-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.445954 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.445764    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.445954 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.445779    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.446874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.446846    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-podinfo" pod "0c2299dc-d499-44f2-ba4f-710d84de4bed" (UID: "0c2299dc-d499-44f2-ba4f-710d84de4bed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:26:29.447398 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.447346    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-token" pod "0c2299dc-d499-44f2-ba4f-710d84de4bed" (UID: "0c2299dc-d499-44f2-ba4f-710d84de4bed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:29.447600 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.447571    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-envoy" pod "0c2299dc-d499-44f2-ba4f-710d84de4bed" (UID: "0c2299dc-d499-44f2-ba4f-710d84de4bed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:29.447855 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.447834    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c2299dc-d499-44f2-ba4f-710d84de4bed-kube-api-access-p8qb2" pod "0c2299dc-d499-44f2-ba4f-710d84de4bed" (UID: "0c2299dc-d499-44f2-ba4f-710d84de4bed"). InnerVolumeSpecName "kube-api-access-p8qb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:29.547949 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.547912    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c2299dc-d499-44f2-ba4f-710d84de4bed-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.547949 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.547952    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8qb2\" (UniqueName: \"kubernetes.io/projected/0c2299dc-d499-44f2-ba4f-710d84de4bed-kube-api-access-p8qb2\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.548218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.547970    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.548218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.547985    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:29.548218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:29.548001    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c2299dc-d499-44f2-ba4f-710d84de4bed-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:30.087011 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:30.086982    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"
Oct 30 22:26:30.087011 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:30.087007    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw" event={"ID":"0c2299dc-d499-44f2-ba4f-710d84de4bed","Type":"ContainerDied","Data":"79e67b4e82b66862d72361e2b91ddba1fcc7bd42a7af7be28bc1d3ad6e328afc"}
Oct 30 22:26:30.087563 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:30.087079    5258 scope.go:122] "RemoveContainer" containerID="bb0330d465eacaead77e7112848773f80836c19ed9d892e2eb134d51d501b6a1"
Oct 30 22:26:30.089039 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:30.089011    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"
Oct 30 22:26:30.089164 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:30.089009    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr" event={"ID":"483ce3ac-7be5-43be-ab91-6b26d13f9f80","Type":"ContainerDied","Data":"7c5e8f17a105a7c573cbba1194d420bf9cec71998ef7cc2bdddf8fcb5dc0229c"}
Oct 30 22:26:30.106279 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:30.106259    5258 scope.go:122] "RemoveContainer" containerID="d1d0187c77eb4fa2953cf9f522cc2db0f76c89da21138e34d2e8b593fe3d41c6"
Oct 30 22:26:30.256401 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:30.256324    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"]
Oct 30 22:26:30.305352 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:30.305314    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-4nlvr"]
Oct 30 22:26:30.417234 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:30.417197    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"]
Oct 30 22:26:30.421492 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:30.421467    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-bdbvw"]
Oct 30 22:26:31.385985 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:31.385951    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0c2299dc-d499-44f2-ba4f-710d84de4bed" path="/var/lib/kubelet/pods/0c2299dc-d499-44f2-ba4f-710d84de4bed/volumes"
Oct 30 22:26:31.386710 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:31.386691    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="483ce3ac-7be5-43be-ab91-6b26d13f9f80" path="/var/lib/kubelet/pods/483ce3ac-7be5-43be-ab91-6b26d13f9f80/volumes"
Oct 30 22:26:32.981710 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:32.981674    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:35.285403 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:35.285369    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:35.755076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:35.755039    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:36.509338 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:36.509296    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:37.121868 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:37.121831    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:38.623522 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:38.623482    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:39.466985 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:39.466951    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:26:40.750419 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:40.750387    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:40.977259 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:40.977225    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:43.163133 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:26:43.163088    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:26:43.278601 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.278554    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"]
Oct 30 22:26:43.278839 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.278792    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb" podUID="bb3a9238-cf39-482f-8c63-4f681ca18c4e" containerName="maas-api" containerID="cri-o://1a81d80e0d0868d33f320f7dd6184655c35ab920ab24d170a26ca4ef1419748a" gracePeriod=30
Oct 30 22:26:43.448045 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.447964    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:43.643434 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.643407    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:26:43.798204 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.798118    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb3a9238-cf39-482f-8c63-4f681ca18c4e-kube-api-access-h8tld\" (UniqueName: \"kubernetes.io/projected/bb3a9238-cf39-482f-8c63-4f681ca18c4e-kube-api-access-h8tld\") pod \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") "
Oct 30 22:26:43.798204 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.798184    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bb3a9238-cf39-482f-8c63-4f681ca18c4e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3a9238-cf39-482f-8c63-4f681ca18c4e-openshift-service-ca\") pod \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") "
Oct 30 22:26:43.798430 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.798322    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-metrics-certs\") pod \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") "
Oct 30 22:26:43.798430 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.798379    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-maas-api-tls\") pod \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\" (UID: \"bb3a9238-cf39-482f-8c63-4f681ca18c4e\") "
Oct 30 22:26:43.798853 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.798812    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb3a9238-cf39-482f-8c63-4f681ca18c4e-openshift-service-ca" pod "bb3a9238-cf39-482f-8c63-4f681ca18c4e" (UID: "bb3a9238-cf39-482f-8c63-4f681ca18c4e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:43.799203 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.799141    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb3a9238-cf39-482f-8c63-4f681ca18c4e-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:43.823057 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.823020    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb3a9238-cf39-482f-8c63-4f681ca18c4e-kube-api-access-h8tld" pod "bb3a9238-cf39-482f-8c63-4f681ca18c4e" (UID: "bb3a9238-cf39-482f-8c63-4f681ca18c4e"). InnerVolumeSpecName "kube-api-access-h8tld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:43.823184 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.823057    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-maas-api-tls" pod "bb3a9238-cf39-482f-8c63-4f681ca18c4e" (UID: "bb3a9238-cf39-482f-8c63-4f681ca18c4e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:43.826090 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.825808    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-metrics-certs" pod "bb3a9238-cf39-482f-8c63-4f681ca18c4e" (UID: "bb3a9238-cf39-482f-8c63-4f681ca18c4e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:43.905225 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.903553    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8tld\" (UniqueName: \"kubernetes.io/projected/bb3a9238-cf39-482f-8c63-4f681ca18c4e-kube-api-access-h8tld\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:43.905225 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.903617    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:43.905225 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:43.903633    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb3a9238-cf39-482f-8c63-4f681ca18c4e-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:44.045241 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:44.045196    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:44.299269 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:44.299231    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:44.311520 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:44.304817    5258 generic.go:356] "Generic (PLEG): container finished" podID="bb3a9238-cf39-482f-8c63-4f681ca18c4e" containerID="1a81d80e0d0868d33f320f7dd6184655c35ab920ab24d170a26ca4ef1419748a" exitCode=0
Oct 30 22:26:44.311520 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:44.305108    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb" event={"ID":"bb3a9238-cf39-482f-8c63-4f681ca18c4e","Type":"ContainerDied","Data":"1a81d80e0d0868d33f320f7dd6184655c35ab920ab24d170a26ca4ef1419748a"}
Oct 30 22:26:44.311520 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:44.305160    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb" event={"ID":"bb3a9238-cf39-482f-8c63-4f681ca18c4e","Type":"ContainerDied","Data":"5b5ef739cec4d741b91f02808a22785ce56c06a7e202960673c0e726518fa2b4"}
Oct 30 22:26:44.311520 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:44.305190    5258 scope.go:122] "RemoveContainer" containerID="1a81d80e0d0868d33f320f7dd6184655c35ab920ab24d170a26ca4ef1419748a"
Oct 30 22:26:44.311520 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:44.305347    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"
Oct 30 22:26:44.365714 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:44.365687    5258 scope.go:122] "RemoveContainer" containerID="1a81d80e0d0868d33f320f7dd6184655c35ab920ab24d170a26ca4ef1419748a"
Oct 30 22:26:44.366230 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:26:44.366203    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a81d80e0d0868d33f320f7dd6184655c35ab920ab24d170a26ca4ef1419748a\": container with ID starting with 1a81d80e0d0868d33f320f7dd6184655c35ab920ab24d170a26ca4ef1419748a not found: ID does not exist" containerID="1a81d80e0d0868d33f320f7dd6184655c35ab920ab24d170a26ca4ef1419748a"
Oct 30 22:26:44.366376 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:44.366235    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a81d80e0d0868d33f320f7dd6184655c35ab920ab24d170a26ca4ef1419748a"} err="failed to get container status \"1a81d80e0d0868d33f320f7dd6184655c35ab920ab24d170a26ca4ef1419748a\": rpc error: code = NotFound desc = could not find container \"1a81d80e0d0868d33f320f7dd6184655c35ab920ab24d170a26ca4ef1419748a\": container with ID starting with 1a81d80e0d0868d33f320f7dd6184655c35ab920ab24d170a26ca4ef1419748a not found: ID does not exist"
Oct 30 22:26:44.498456 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:44.498424    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"]
Oct 30 22:26:44.650614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:44.599109    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-367f4491-5c74b7d9d4-s5qgb"]
Oct 30 22:26:45.398312 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:45.398274    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb3a9238-cf39-482f-8c63-4f681ca18c4e" path="/var/lib/kubelet/pods/bb3a9238-cf39-482f-8c63-4f681ca18c4e/volumes"
Oct 30 22:26:45.503196 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:45.503161    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:45.830611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:45.829132    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:46.061611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:46.060142    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:46.667225 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:46.667189    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:51.519615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:51.518270    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:53.971612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:53.971229    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:54.261534 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:54.261437    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:54.264849 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:54.264818    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"]
Oct 30 22:26:54.265381 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:54.265350    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh" podUID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerName="istio-proxy" containerID="cri-o://654f28ae14edc7bf5c3b69dde77ae60a129046ad9802ffe3e3f8710d9e8a76ca" gracePeriod=30
Oct 30 22:26:54.271881 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:54.271859    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"]
Oct 30 22:26:54.272091 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:54.272068    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b" podUID="8a988d31-7005-41b0-ac0f-035ffa56d327" containerName="istio-proxy" containerID="cri-o://703555a5870cb96f6d88001da8a472b1ed1f03bdee8bc391d8593649dad8c418" gracePeriod=30
Oct 30 22:26:54.300943 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:54.300914    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"]
Oct 30 22:26:54.301114 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:54.301095    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f" podUID="fd5b3786-dca1-47f9-919b-ecfc85009613" containerName="istio-proxy" containerID="cri-o://75a583fc9fe51ce70894894d0e6bf2d5a44d77055f2242e8f713b4c990377631" gracePeriod=30
Oct 30 22:26:54.486659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:54.479239    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:55.401875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:55.401839    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:55.694087 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:55.693998    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:56.734447 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:56.734412    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:57.130154 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:57.129354    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:57.352176 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:57.352140    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:59.528445 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.528406    5258 generic.go:356] "Generic (PLEG): container finished" podID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerID="654f28ae14edc7bf5c3b69dde77ae60a129046ad9802ffe3e3f8710d9e8a76ca" exitCode=0
Oct 30 22:26:59.528896 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.528511    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh" event={"ID":"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78","Type":"ContainerDied","Data":"654f28ae14edc7bf5c3b69dde77ae60a129046ad9802ffe3e3f8710d9e8a76ca"}
Oct 30 22:26:59.528896 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.528574    5258 scope.go:122] "RemoveContainer" containerID="ea7f4b5f439ecf9225daa03d384abfde1247ed3911d13b81aff2b8780f2aa3a6"
Oct 30 22:26:59.539806 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.539274    5258 generic.go:356] "Generic (PLEG): container finished" podID="fd5b3786-dca1-47f9-919b-ecfc85009613" containerID="75a583fc9fe51ce70894894d0e6bf2d5a44d77055f2242e8f713b4c990377631" exitCode=0
Oct 30 22:26:59.539806 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.539383    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f" event={"ID":"fd5b3786-dca1-47f9-919b-ecfc85009613","Type":"ContainerDied","Data":"75a583fc9fe51ce70894894d0e6bf2d5a44d77055f2242e8f713b4c990377631"}
Oct 30 22:26:59.542187 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.541974    5258 generic.go:356] "Generic (PLEG): container finished" podID="8a988d31-7005-41b0-ac0f-035ffa56d327" containerID="703555a5870cb96f6d88001da8a472b1ed1f03bdee8bc391d8593649dad8c418" exitCode=0
Oct 30 22:26:59.542187 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.542118    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b" event={"ID":"8a988d31-7005-41b0-ac0f-035ffa56d327","Type":"ContainerDied","Data":"703555a5870cb96f6d88001da8a472b1ed1f03bdee8bc391d8593649dad8c418"}
Oct 30 22:26:59.610880 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.610848    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:26:59.618208 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.618185    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:26:59.676551 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.676527    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:26:59.723852 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.723822    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-workload-socket\") pod \"8a988d31-7005-41b0-ac0f-035ffa56d327\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") "
Oct 30 22:26:59.723977 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.723877    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-token\" (UniqueName: \"kubernetes.io/projected/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-token\") pod \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") "
Oct 30 22:26:59.723977 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.723944    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a988d31-7005-41b0-ac0f-035ffa56d327-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a988d31-7005-41b0-ac0f-035ffa56d327-istiod-ca-cert\") pod \"8a988d31-7005-41b0-ac0f-035ffa56d327\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") "
Oct 30 22:26:59.724091 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724001    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-envoy\") pod \"8a988d31-7005-41b0-ac0f-035ffa56d327\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") "
Oct 30 22:26:59.724091 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724059    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-data\") pod \"8a988d31-7005-41b0-ac0f-035ffa56d327\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") "
Oct 30 22:26:59.724190 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724089    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istiod-ca-cert\") pod \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") "
Oct 30 22:26:59.724190 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724124    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-workload-socket" pod "8a988d31-7005-41b0-ac0f-035ffa56d327" (UID: "8a988d31-7005-41b0-ac0f-035ffa56d327"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.724190 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724136    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-credential-socket\") pod \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") "
Oct 30 22:26:59.724190 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724163    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-data\") pod \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") "
Oct 30 22:26:59.724400 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724191    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-credential-socket\") pod \"8a988d31-7005-41b0-ac0f-035ffa56d327\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") "
Oct 30 22:26:59.724400 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724228    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-podinfo\") pod \"8a988d31-7005-41b0-ac0f-035ffa56d327\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") "
Oct 30 22:26:59.724400 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724276    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-workload-socket\") pod \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") "
Oct 30 22:26:59.724555 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724403    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-kube-api-access-grvmx\" (UniqueName: \"kubernetes.io/projected/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-kube-api-access-grvmx\") pod \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") "
Oct 30 22:26:59.724555 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724412    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a988d31-7005-41b0-ac0f-035ffa56d327-istiod-ca-cert" pod "8a988d31-7005-41b0-ac0f-035ffa56d327" (UID: "8a988d31-7005-41b0-ac0f-035ffa56d327"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:59.724555 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724481    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-workload-certs\") pod \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") "
Oct 30 22:26:59.724555 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724520    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-token\" (UniqueName: \"kubernetes.io/projected/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-token\") pod \"8a988d31-7005-41b0-ac0f-035ffa56d327\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") "
Oct 30 22:26:59.724786 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724581    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-podinfo\") pod \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") "
Oct 30 22:26:59.724786 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724662    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-envoy\") pod \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\" (UID: \"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78\") "
Oct 30 22:26:59.724786 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724484    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istiod-ca-cert" pod "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" (UID: "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:59.724786 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724655    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-credential-socket" pod "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" (UID: "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.724786 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724683    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-workload-socket" pod "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" (UID: "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.724786 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724709    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-data" pod "8a988d31-7005-41b0-ac0f-035ffa56d327" (UID: "8a988d31-7005-41b0-ac0f-035ffa56d327"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.725095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724809    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-credential-socket" pod "8a988d31-7005-41b0-ac0f-035ffa56d327" (UID: "8a988d31-7005-41b0-ac0f-035ffa56d327"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.725095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724813    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-data" pod "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" (UID: "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.725095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724825    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-workload-certs\") pod \"8a988d31-7005-41b0-ac0f-035ffa56d327\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") "
Oct 30 22:26:59.725095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.724878    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a988d31-7005-41b0-ac0f-035ffa56d327-kube-api-access-c9xss\" (UniqueName: \"kubernetes.io/projected/8a988d31-7005-41b0-ac0f-035ffa56d327-kube-api-access-c9xss\") pod \"8a988d31-7005-41b0-ac0f-035ffa56d327\" (UID: \"8a988d31-7005-41b0-ac0f-035ffa56d327\") "
Oct 30 22:26:59.725095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.725000    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-workload-certs" pod "8a988d31-7005-41b0-ac0f-035ffa56d327" (UID: "8a988d31-7005-41b0-ac0f-035ffa56d327"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.725095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.725013    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-workload-certs" pod "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" (UID: "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.726111 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.726056    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.726238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.726116    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.726238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.726131    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a988d31-7005-41b0-ac0f-035ffa56d327-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.726238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.726144    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.726238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.726179    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.726238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.726194    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.726238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.726208    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.726238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.726220    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.726522 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.726254    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.726522 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.726269    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.727162 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.727131    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-token" pod "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" (UID: "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:59.727269 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.727178    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-podinfo" pod "8a988d31-7005-41b0-ac0f-035ffa56d327" (UID: "8a988d31-7005-41b0-ac0f-035ffa56d327"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:26:59.727657 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.727632    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-token" pod "8a988d31-7005-41b0-ac0f-035ffa56d327" (UID: "8a988d31-7005-41b0-ac0f-035ffa56d327"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:59.727838 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.727810    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-envoy" pod "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" (UID: "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.728113 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.728093    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-envoy" pod "8a988d31-7005-41b0-ac0f-035ffa56d327" (UID: "8a988d31-7005-41b0-ac0f-035ffa56d327"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.728189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.728170    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-kube-api-access-grvmx" pod "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" (UID: "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78"). InnerVolumeSpecName "kube-api-access-grvmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:59.728324 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.728309    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-podinfo" pod "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" (UID: "d0b85f08-4ff4-4a51-b6fd-59a2a5600b78"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:26:59.728810 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.728792    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a988d31-7005-41b0-ac0f-035ffa56d327-kube-api-access-c9xss" pod "8a988d31-7005-41b0-ac0f-035ffa56d327" (UID: "8a988d31-7005-41b0-ac0f-035ffa56d327"). InnerVolumeSpecName "kube-api-access-c9xss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:59.827768 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.827734    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fd5b3786-dca1-47f9-919b-ecfc85009613-kube-api-access-p5rpj\" (UniqueName: \"kubernetes.io/projected/fd5b3786-dca1-47f9-919b-ecfc85009613-kube-api-access-p5rpj\") pod \"fd5b3786-dca1-47f9-919b-ecfc85009613\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") "
Oct 30 22:26:59.827974 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.827787    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fd5b3786-dca1-47f9-919b-ecfc85009613-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd5b3786-dca1-47f9-919b-ecfc85009613-istiod-ca-cert\") pod \"fd5b3786-dca1-47f9-919b-ecfc85009613\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") "
Oct 30 22:26:59.827974 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.827929    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-credential-socket\") pod \"fd5b3786-dca1-47f9-919b-ecfc85009613\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") "
Oct 30 22:26:59.828188 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.828164    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-podinfo\") pod \"fd5b3786-dca1-47f9-919b-ecfc85009613\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") "
Oct 30 22:26:59.828285 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.828208    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-credential-socket" pod "fd5b3786-dca1-47f9-919b-ecfc85009613" (UID: "fd5b3786-dca1-47f9-919b-ecfc85009613"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.828285 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.828258    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-token\" (UniqueName: \"kubernetes.io/projected/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-token\") pod \"fd5b3786-dca1-47f9-919b-ecfc85009613\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") "
Oct 30 22:26:59.828285 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.828269    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd5b3786-dca1-47f9-919b-ecfc85009613-istiod-ca-cert" pod "fd5b3786-dca1-47f9-919b-ecfc85009613" (UID: "fd5b3786-dca1-47f9-919b-ecfc85009613"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:59.828465 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.828299    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-workload-socket\") pod \"fd5b3786-dca1-47f9-919b-ecfc85009613\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") "
Oct 30 22:26:59.828465 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.828354    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-workload-certs\") pod \"fd5b3786-dca1-47f9-919b-ecfc85009613\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") "
Oct 30 22:26:59.828465 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.828407    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-data\") pod \"fd5b3786-dca1-47f9-919b-ecfc85009613\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") "
Oct 30 22:26:59.828641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.828463    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-envoy\") pod \"fd5b3786-dca1-47f9-919b-ecfc85009613\" (UID: \"fd5b3786-dca1-47f9-919b-ecfc85009613\") "
Oct 30 22:26:59.829631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.829176    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.829631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.829206    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.829631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.829221    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.829631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.829235    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9xss\" (UniqueName: \"kubernetes.io/projected/8a988d31-7005-41b0-ac0f-035ffa56d327-kube-api-access-c9xss\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.829631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.829249    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.829631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.829264    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.829631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.829277    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd5b3786-dca1-47f9-919b-ecfc85009613-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.829631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.829304    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a988d31-7005-41b0-ac0f-035ffa56d327-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.829631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.829318    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.829631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.829333    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grvmx\" (UniqueName: \"kubernetes.io/projected/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78-kube-api-access-grvmx\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.830296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.829757    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-workload-socket" pod "fd5b3786-dca1-47f9-919b-ecfc85009613" (UID: "fd5b3786-dca1-47f9-919b-ecfc85009613"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.830296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.829843    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-data" pod "fd5b3786-dca1-47f9-919b-ecfc85009613" (UID: "fd5b3786-dca1-47f9-919b-ecfc85009613"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.830296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.829896    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-workload-certs" pod "fd5b3786-dca1-47f9-919b-ecfc85009613" (UID: "fd5b3786-dca1-47f9-919b-ecfc85009613"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.831069 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.831046    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-podinfo" pod "fd5b3786-dca1-47f9-919b-ecfc85009613" (UID: "fd5b3786-dca1-47f9-919b-ecfc85009613"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:26:59.831069 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.831059    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-token" pod "fd5b3786-dca1-47f9-919b-ecfc85009613" (UID: "fd5b3786-dca1-47f9-919b-ecfc85009613"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:59.831922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.831899    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-envoy" pod "fd5b3786-dca1-47f9-919b-ecfc85009613" (UID: "fd5b3786-dca1-47f9-919b-ecfc85009613"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:59.832011 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.831932    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd5b3786-dca1-47f9-919b-ecfc85009613-kube-api-access-p5rpj" pod "fd5b3786-dca1-47f9-919b-ecfc85009613" (UID: "fd5b3786-dca1-47f9-919b-ecfc85009613"). InnerVolumeSpecName "kube-api-access-p5rpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:59.931385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.931352    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.931385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.931383    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5rpj\" (UniqueName: \"kubernetes.io/projected/fd5b3786-dca1-47f9-919b-ecfc85009613-kube-api-access-p5rpj\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.931646 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.931397    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.931646 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.931410    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.931646 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.931427    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.931646 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.931438    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:59.931646 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:26:59.931452    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd5b3786-dca1-47f9-919b-ecfc85009613-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:00.551318 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.551231    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"
Oct 30 22:27:00.551318 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.551232    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh" event={"ID":"d0b85f08-4ff4-4a51-b6fd-59a2a5600b78","Type":"ContainerDied","Data":"376ca8497c3c70f2cd50d0cd1b8d2486a4562b0617e04efb6ec826317c00878e"}
Oct 30 22:27:00.551945 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.551350    5258 scope.go:122] "RemoveContainer" containerID="654f28ae14edc7bf5c3b69dde77ae60a129046ad9802ffe3e3f8710d9e8a76ca"
Oct 30 22:27:00.552968 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.552951    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"
Oct 30 22:27:00.553077 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.552958    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f" event={"ID":"fd5b3786-dca1-47f9-919b-ecfc85009613","Type":"ContainerDied","Data":"0849afb8770cfe4ef2463f5eebcc806c22c8adfd58d5a310126d76a72b657177"}
Oct 30 22:27:00.555020 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.554998    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"
Oct 30 22:27:00.555162 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.555067    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b" event={"ID":"8a988d31-7005-41b0-ac0f-035ffa56d327","Type":"ContainerDied","Data":"810036ff7a9b6093a78c9d4af085a20ee77527fea305a8a44b81c2bdf9d79d2d"}
Oct 30 22:27:00.563292 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.563270    5258 scope.go:122] "RemoveContainer" containerID="75a583fc9fe51ce70894894d0e6bf2d5a44d77055f2242e8f713b4c990377631"
Oct 30 22:27:00.574874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.574855    5258 scope.go:122] "RemoveContainer" containerID="703555a5870cb96f6d88001da8a472b1ed1f03bdee8bc391d8593649dad8c418"
Oct 30 22:27:00.722019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.721985    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"]
Oct 30 22:27:00.770255 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.770220    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-5j8gh"]
Oct 30 22:27:00.833342 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.833309    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"]
Oct 30 22:27:00.840452 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.840423    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-n2j4b"]
Oct 30 22:27:00.948634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.948581    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"]
Oct 30 22:27:00.957972 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:00.957927    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-367f4491-openshift-default-5f467bc7d9-g8l5f"]
Oct 30 22:27:01.396614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:01.395643    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a988d31-7005-41b0-ac0f-035ffa56d327" path="/var/lib/kubelet/pods/8a988d31-7005-41b0-ac0f-035ffa56d327/volumes"
Oct 30 22:27:01.402614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:01.399519    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" path="/var/lib/kubelet/pods/d0b85f08-4ff4-4a51-b6fd-59a2a5600b78/volumes"
Oct 30 22:27:01.402614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:01.400327    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fd5b3786-dca1-47f9-919b-ecfc85009613" path="/var/lib/kubelet/pods/fd5b3786-dca1-47f9-919b-ecfc85009613/volumes"
Oct 30 22:27:01.840722 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:01.840674    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:02.068426 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:02.068384    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:02.423354 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:02.423318    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:02.877834 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:02.877791    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:04.979550 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:04.979515    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:05.458909 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:05.458879    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:06.359739 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.359691    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"]
Oct 30 22:27:06.360605 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360568    5258 cpu_manager.go:414] "containerMap: removing container" podUID="8a988d31-7005-41b0-ac0f-035ffa56d327" containerName="istio-proxy"
Oct 30 22:27:06.360724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360607    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a988d31-7005-41b0-ac0f-035ffa56d327" containerName="istio-proxy"
Oct 30 22:27:06.360724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360638    5258 cpu_manager.go:414] "containerMap: removing container" podUID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerName="istio-proxy"
Oct 30 22:27:06.360724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360646    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerName="istio-proxy"
Oct 30 22:27:06.360724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360660    5258 cpu_manager.go:414] "containerMap: removing container" podUID="0c2299dc-d499-44f2-ba4f-710d84de4bed" containerName="istio-proxy"
Oct 30 22:27:06.360724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360668    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c2299dc-d499-44f2-ba4f-710d84de4bed" containerName="istio-proxy"
Oct 30 22:27:06.360724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360681    5258 cpu_manager.go:414] "containerMap: removing container" podUID="483ce3ac-7be5-43be-ab91-6b26d13f9f80" containerName="istio-proxy"
Oct 30 22:27:06.360724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360688    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="483ce3ac-7be5-43be-ab91-6b26d13f9f80" containerName="istio-proxy"
Oct 30 22:27:06.360724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360700    5258 cpu_manager.go:414] "containerMap: removing container" podUID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerName="istio-proxy"
Oct 30 22:27:06.360724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360707    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerName="istio-proxy"
Oct 30 22:27:06.360724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360722    5258 cpu_manager.go:414] "containerMap: removing container" podUID="fd5b3786-dca1-47f9-919b-ecfc85009613" containerName="istio-proxy"
Oct 30 22:27:06.361230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360729    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fd5b3786-dca1-47f9-919b-ecfc85009613" containerName="istio-proxy"
Oct 30 22:27:06.361230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360755    5258 cpu_manager.go:414] "containerMap: removing container" podUID="9dd33760-037c-41b0-848d-50c297665fd8" containerName="payload-pre-processing"
Oct 30 22:27:06.361230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360763    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9dd33760-037c-41b0-848d-50c297665fd8" containerName="payload-pre-processing"
Oct 30 22:27:06.361230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360804    5258 cpu_manager.go:414] "containerMap: removing container" podUID="bb3a9238-cf39-482f-8c63-4f681ca18c4e" containerName="maas-api"
Oct 30 22:27:06.361230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360813    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb3a9238-cf39-482f-8c63-4f681ca18c4e" containerName="maas-api"
Oct 30 22:27:06.361230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.360998    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerName="istio-proxy"
Oct 30 22:27:06.361230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.361014    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="0c2299dc-d499-44f2-ba4f-710d84de4bed" containerName="istio-proxy"
Oct 30 22:27:06.361230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.361022    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="483ce3ac-7be5-43be-ab91-6b26d13f9f80" containerName="istio-proxy"
Oct 30 22:27:06.361230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.361031    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0b85f08-4ff4-4a51-b6fd-59a2a5600b78" containerName="istio-proxy"
Oct 30 22:27:06.361230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.361039    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="fd5b3786-dca1-47f9-919b-ecfc85009613" containerName="istio-proxy"
Oct 30 22:27:06.361230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.361050    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="9dd33760-037c-41b0-848d-50c297665fd8" containerName="payload-pre-processing"
Oct 30 22:27:06.361230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.361064    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb3a9238-cf39-482f-8c63-4f681ca18c4e" containerName="maas-api"
Oct 30 22:27:06.361230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.361077    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a988d31-7005-41b0-ac0f-035ffa56d327" containerName="istio-proxy"
Oct 30 22:27:06.366825 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.366802    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.389217 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.389191    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-data\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.389362 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.389234    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-workload-certs\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.389362 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.389259    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-envoy\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.389486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.389373    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-token\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.389576 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.389560    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-podinfo\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.389726 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.389709    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-workload-socket\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.389888 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.389859    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5285d\" (UniqueName: \"kubernetes.io/projected/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-kube-api-access-5285d\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.390012 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.389931    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-credential-socket\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.390084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.390041    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istiod-ca-cert\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.420943 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.420906    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w5-b7588a-openshift-default-dockercfg-m4zt4\""
Oct 30 22:27:06.476553 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.476521    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"]
Oct 30 22:27:06.572002 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.556132    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-podinfo\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.572447 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.572387    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-workload-socket\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.572649 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.572626    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5285d\" (UniqueName: \"kubernetes.io/projected/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-kube-api-access-5285d\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.572857 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.572836    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-credential-socket\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.573113 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.573073    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-workload-socket\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.573113 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.573092    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istiod-ca-cert\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.573312 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.573199    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-data\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.573312 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.573247    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-workload-certs\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.573312 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.573282    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-envoy\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.573480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.573313    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-token\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.573771 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.573730    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istiod-ca-cert\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.574054 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.574031    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-data\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.577843 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.576535    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:06.588803 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.588748    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-workload-certs\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.589231 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.589189    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-credential-socket\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.594180 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.594085    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-podinfo\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.612434 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.612372    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-envoy\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.638751 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.638717    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5285d\" (UniqueName: \"kubernetes.io/projected/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-kube-api-access-5285d\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.638974 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.638952    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-token\") pod \"e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") " pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.689234 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.689167    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:06.811638 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:06.810859    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:07.046542 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:07.046428    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:07.165824 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:07.165795    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"]
Oct 30 22:27:07.166664 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:27:07.166640    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0aea57b_aa20_45dc_8d42_dfcf009bc6c8.slice/crio-2afbc855a782553b84928532a22b50ff942c1a5e45f5f0ee9ed42983bcddf65f WatchSource:0}: Error finding container 2afbc855a782553b84928532a22b50ff942c1a5e45f5f0ee9ed42983bcddf65f: Status 404 returned error can't find the container with id 2afbc855a782553b84928532a22b50ff942c1a5e45f5f0ee9ed42983bcddf65f
Oct 30 22:27:07.170063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:07.170031    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:27:07.170160 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:07.170103    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:27:07.170160 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:07.170133    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:27:07.288987 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:07.288952    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:07.761976 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:07.761939    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k" event={"ID":"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8","Type":"ContainerStarted","Data":"ec3296d8e7e4ca39d4c55ae9bee5c6357ba9375afb937b395f2cd0ea60013a87"}
Oct 30 22:27:07.762392 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:07.762000    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k" event={"ID":"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8","Type":"ContainerStarted","Data":"2afbc855a782553b84928532a22b50ff942c1a5e45f5f0ee9ed42983bcddf65f"}
Oct 30 22:27:07.887042 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:07.886989    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k" podStartSLOduration=1.8869753409999999 podStartE2EDuration="1.886975341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:27:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:27:07.882844828 +0000 UTC m=+1942.613701973" watchObservedRunningTime="2026-10-30 22:27:07.886975341 +0000 UTC m=+1942.617832562"
Oct 30 22:27:08.690440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:08.690406    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:08.696942 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:08.696914    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:08.771579 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:08.771550    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:08.772549 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:08.772528    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:27:08.915322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:08.915284    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:09.148660 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:09.148622    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"]
Oct 30 22:27:09.148951 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:09.148896    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj" podUID="ebee4cde-8248-44a5-bba0-c6321764dec0" containerName="istio-proxy" containerID="cri-o://4d9069551aabaa09fb4ca520029ac6a4d807ea58e051026e23812869e7b9ecc3" gracePeriod=30
Oct 30 22:27:09.245854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:09.245817    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:09.463137 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:09.463053    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:09.549613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:09.546028    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"]
Oct 30 22:27:09.549613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:09.546237    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v" podUID="f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" containerName="istio-proxy" containerID="cri-o://763a7c7a5b2e2ed5a0cb31235cf4ab6c9c97c6de9b3b1ef351afa36f66eee23c" gracePeriod=30
Oct 30 22:27:09.586460 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:09.586414    5258 patch_prober.go:29] interesting pod/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:27:09.586666 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:09.586483    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj" podUID="ebee4cde-8248-44a5-bba0-c6321764dec0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:27:11.838430 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:11.838388    5258 patch_prober.go:29] interesting pod/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:27:11.838938 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:11.838469    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v" podUID="f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:27:11.884530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:11.884490    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:12.179658 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:12.177089    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:12.408612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:12.407728    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:12.624902 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:12.624236    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:13.169269 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:27:13.169227    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:27:14.519177 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.519151    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:27:14.613747 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.613721    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-token\" (UniqueName: \"kubernetes.io/projected/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-token\") pod \"ebee4cde-8248-44a5-bba0-c6321764dec0\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") "
Oct 30 22:27:14.613861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.613812    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-data\") pod \"ebee4cde-8248-44a5-bba0-c6321764dec0\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") "
Oct 30 22:27:14.613861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.613857    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-workload-certs\") pod \"ebee4cde-8248-44a5-bba0-c6321764dec0\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") "
Oct 30 22:27:14.613944 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.613932    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ebee4cde-8248-44a5-bba0-c6321764dec0-kube-api-access-dzhs7\" (UniqueName: \"kubernetes.io/projected/ebee4cde-8248-44a5-bba0-c6321764dec0-kube-api-access-dzhs7\") pod \"ebee4cde-8248-44a5-bba0-c6321764dec0\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") "
Oct 30 22:27:14.613988 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.613973    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-credential-socket\") pod \"ebee4cde-8248-44a5-bba0-c6321764dec0\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") "
Oct 30 22:27:14.614035 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.614013    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-workload-socket\") pod \"ebee4cde-8248-44a5-bba0-c6321764dec0\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") "
Oct 30 22:27:14.614083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.614052    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ebee4cde-8248-44a5-bba0-c6321764dec0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebee4cde-8248-44a5-bba0-c6321764dec0-istiod-ca-cert\") pod \"ebee4cde-8248-44a5-bba0-c6321764dec0\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") "
Oct 30 22:27:14.614156 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.614102    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-podinfo\") pod \"ebee4cde-8248-44a5-bba0-c6321764dec0\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") "
Oct 30 22:27:14.614156 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.614133    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-data" pod "ebee4cde-8248-44a5-bba0-c6321764dec0" (UID: "ebee4cde-8248-44a5-bba0-c6321764dec0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:14.614276 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.614175    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-envoy\") pod \"ebee4cde-8248-44a5-bba0-c6321764dec0\" (UID: \"ebee4cde-8248-44a5-bba0-c6321764dec0\") "
Oct 30 22:27:14.614276 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.614204    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-workload-certs" pod "ebee4cde-8248-44a5-bba0-c6321764dec0" (UID: "ebee4cde-8248-44a5-bba0-c6321764dec0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:14.614384 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.614267    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-credential-socket" pod "ebee4cde-8248-44a5-bba0-c6321764dec0" (UID: "ebee4cde-8248-44a5-bba0-c6321764dec0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:14.614384 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.614299    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-workload-socket" pod "ebee4cde-8248-44a5-bba0-c6321764dec0" (UID: "ebee4cde-8248-44a5-bba0-c6321764dec0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:14.614469 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.614405    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebee4cde-8248-44a5-bba0-c6321764dec0-istiod-ca-cert" pod "ebee4cde-8248-44a5-bba0-c6321764dec0" (UID: "ebee4cde-8248-44a5-bba0-c6321764dec0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:27:14.614893 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.614868    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:14.615003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.614899    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:14.615003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.614915    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:14.615003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.614930    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:14.615003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.614945    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ebee4cde-8248-44a5-bba0-c6321764dec0-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:14.616158 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.616138    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-token" pod "ebee4cde-8248-44a5-bba0-c6321764dec0" (UID: "ebee4cde-8248-44a5-bba0-c6321764dec0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:27:14.616256 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.616175    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-envoy" pod "ebee4cde-8248-44a5-bba0-c6321764dec0" (UID: "ebee4cde-8248-44a5-bba0-c6321764dec0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:14.616340 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.616306    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-podinfo" pod "ebee4cde-8248-44a5-bba0-c6321764dec0" (UID: "ebee4cde-8248-44a5-bba0-c6321764dec0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:27:14.616415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.616392    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebee4cde-8248-44a5-bba0-c6321764dec0-kube-api-access-dzhs7" pod "ebee4cde-8248-44a5-bba0-c6321764dec0" (UID: "ebee4cde-8248-44a5-bba0-c6321764dec0"). InnerVolumeSpecName "kube-api-access-dzhs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:27:14.716940 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.716904    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:14.716940 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.716935    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzhs7\" (UniqueName: \"kubernetes.io/projected/ebee4cde-8248-44a5-bba0-c6321764dec0-kube-api-access-dzhs7\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:14.717191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.716950    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:14.717191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.716965    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ebee4cde-8248-44a5-bba0-c6321764dec0-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:14.851156 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.851131    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:27:14.912622 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.912553    5258 generic.go:356] "Generic (PLEG): container finished" podID="f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" containerID="763a7c7a5b2e2ed5a0cb31235cf4ab6c9c97c6de9b3b1ef351afa36f66eee23c" exitCode=0
Oct 30 22:27:14.912791 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.912641    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"
Oct 30 22:27:14.912791 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.912643    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v" event={"ID":"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776","Type":"ContainerDied","Data":"763a7c7a5b2e2ed5a0cb31235cf4ab6c9c97c6de9b3b1ef351afa36f66eee23c"}
Oct 30 22:27:14.912791 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.912742    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v" event={"ID":"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776","Type":"ContainerDied","Data":"9b18517985d7644478f259455734bdbc2b30700d85f8ce5f9dd04960fd7b6375"}
Oct 30 22:27:14.912791 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.912755    5258 scope.go:122] "RemoveContainer" containerID="763a7c7a5b2e2ed5a0cb31235cf4ab6c9c97c6de9b3b1ef351afa36f66eee23c"
Oct 30 22:27:14.914224 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.914200    5258 generic.go:356] "Generic (PLEG): container finished" podID="ebee4cde-8248-44a5-bba0-c6321764dec0" containerID="4d9069551aabaa09fb4ca520029ac6a4d807ea58e051026e23812869e7b9ecc3" exitCode=0
Oct 30 22:27:14.914331 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.914252    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"
Oct 30 22:27:14.914331 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.914279    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj" event={"ID":"ebee4cde-8248-44a5-bba0-c6321764dec0","Type":"ContainerDied","Data":"4d9069551aabaa09fb4ca520029ac6a4d807ea58e051026e23812869e7b9ecc3"}
Oct 30 22:27:14.914331 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.914327    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj" event={"ID":"ebee4cde-8248-44a5-bba0-c6321764dec0","Type":"ContainerDied","Data":"5cf8a8f63437966f5cead063d317b0de14b60f370bedb29f6d1af7ce1f40fe10"}
Oct 30 22:27:14.918349 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.918324    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-credential-socket\") pod \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") "
Oct 30 22:27:14.918471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.918391    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-workload-certs\") pod \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") "
Oct 30 22:27:14.918536 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.918467    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-data\") pod \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") "
Oct 30 22:27:14.918623 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.918547    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-credential-socket" pod "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" (UID: "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:14.918700 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.918632    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-workload-socket\") pod \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") "
Oct 30 22:27:14.918759 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.918710    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-workload-certs" pod "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" (UID: "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:14.918816 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.918764    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-token\" (UniqueName: \"kubernetes.io/projected/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-token\") pod \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") "
Oct 30 22:27:14.918816 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.918768    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-data" pod "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" (UID: "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:14.918918 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.918846    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-kube-api-access-hcrzb\" (UniqueName: \"kubernetes.io/projected/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-kube-api-access-hcrzb\") pod \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") "
Oct 30 22:27:14.918918 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.918891    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-envoy\") pod \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") "
Oct 30 22:27:14.919025 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.918947    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-workload-socket" pod "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" (UID: "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:14.919025 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.918972    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istiod-ca-cert\") pod \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") "
Oct 30 22:27:14.919025 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.919003    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-podinfo\") pod \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\" (UID: \"f9a572fa-5ae1-4e61-aa67-d2bf19dd4776\") "
Oct 30 22:27:14.919551 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.919511    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istiod-ca-cert" pod "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" (UID: "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:27:14.919676 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.919647    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:14.919676 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.919668    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:14.919782 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.919683    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:14.919782 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.919696    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:14.919782 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.919709    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:14.922907 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.922244    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-token" pod "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" (UID: "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:27:14.926066 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.923458    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-envoy" pod "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" (UID: "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:27:14.926066 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.924289    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-podinfo" pod "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" (UID: "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:27:14.930472 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.930165    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-kube-api-access-hcrzb" pod "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" (UID: "f9a572fa-5ae1-4e61-aa67-d2bf19dd4776"). InnerVolumeSpecName "kube-api-access-hcrzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:27:14.975628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.967895    5258 scope.go:122] "RemoveContainer" containerID="763a7c7a5b2e2ed5a0cb31235cf4ab6c9c97c6de9b3b1ef351afa36f66eee23c"
Oct 30 22:27:14.975628 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:27:14.969328    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"763a7c7a5b2e2ed5a0cb31235cf4ab6c9c97c6de9b3b1ef351afa36f66eee23c\": container with ID starting with 763a7c7a5b2e2ed5a0cb31235cf4ab6c9c97c6de9b3b1ef351afa36f66eee23c not found: ID does not exist" containerID="763a7c7a5b2e2ed5a0cb31235cf4ab6c9c97c6de9b3b1ef351afa36f66eee23c"
Oct 30 22:27:14.975628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.969368    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"763a7c7a5b2e2ed5a0cb31235cf4ab6c9c97c6de9b3b1ef351afa36f66eee23c"} err="failed to get container status \"763a7c7a5b2e2ed5a0cb31235cf4ab6c9c97c6de9b3b1ef351afa36f66eee23c\": rpc error: code = NotFound desc = could not find container \"763a7c7a5b2e2ed5a0cb31235cf4ab6c9c97c6de9b3b1ef351afa36f66eee23c\": container with ID starting with 763a7c7a5b2e2ed5a0cb31235cf4ab6c9c97c6de9b3b1ef351afa36f66eee23c not found: ID does not exist"
Oct 30 22:27:14.975628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.969395    5258 scope.go:122] "RemoveContainer" containerID="4d9069551aabaa09fb4ca520029ac6a4d807ea58e051026e23812869e7b9ecc3"
Oct 30 22:27:14.975628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:14.969744    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:15.021218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:15.021119    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:15.021218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:15.021158    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:15.021218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:15.021174    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcrzb\" (UniqueName: \"kubernetes.io/projected/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-kube-api-access-hcrzb\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:15.021218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:15.021191    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:15.031823 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:15.031802    5258 scope.go:122] "RemoveContainer" containerID="4d9069551aabaa09fb4ca520029ac6a4d807ea58e051026e23812869e7b9ecc3"
Oct 30 22:27:15.032137 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:27:15.032114    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d9069551aabaa09fb4ca520029ac6a4d807ea58e051026e23812869e7b9ecc3\": container with ID starting with 4d9069551aabaa09fb4ca520029ac6a4d807ea58e051026e23812869e7b9ecc3 not found: ID does not exist" containerID="4d9069551aabaa09fb4ca520029ac6a4d807ea58e051026e23812869e7b9ecc3"
Oct 30 22:27:15.032247 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:15.032143    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d9069551aabaa09fb4ca520029ac6a4d807ea58e051026e23812869e7b9ecc3"} err="failed to get container status \"4d9069551aabaa09fb4ca520029ac6a4d807ea58e051026e23812869e7b9ecc3\": rpc error: code = NotFound desc = could not find container \"4d9069551aabaa09fb4ca520029ac6a4d807ea58e051026e23812869e7b9ecc3\": container with ID starting with 4d9069551aabaa09fb4ca520029ac6a4d807ea58e051026e23812869e7b9ecc3 not found: ID does not exist"
Oct 30 22:27:15.105780 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:15.105692    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"]
Oct 30 22:27:15.109416 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:15.109392    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-m2rgj"]
Oct 30 22:27:15.338549 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:15.338509    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:15.340390 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:15.340367    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"]
Oct 30 22:27:15.352140 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:15.352118    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-rwr7v"]
Oct 30 22:27:15.385032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:15.384965    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ebee4cde-8248-44a5-bba0-c6321764dec0" path="/var/lib/kubelet/pods/ebee4cde-8248-44a5-bba0-c6321764dec0/volumes"
Oct 30 22:27:15.385473 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:15.385458    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" path="/var/lib/kubelet/pods/f9a572fa-5ae1-4e61-aa67-d2bf19dd4776/volumes"
Oct 30 22:27:20.524831 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:20.524782    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:21.372554 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:21.372517    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:27:21.636692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:21.634164    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:21.865766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:21.865727    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:21.915908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:21.915817    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"]
Oct 30 22:27:21.916557 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:21.916524    5258 cpu_manager.go:414] "containerMap: removing container" podUID="ebee4cde-8248-44a5-bba0-c6321764dec0" containerName="istio-proxy"
Oct 30 22:27:21.916557 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:21.916544    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ebee4cde-8248-44a5-bba0-c6321764dec0" containerName="istio-proxy"
Oct 30 22:27:21.916557 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:21.916561    5258 cpu_manager.go:414] "containerMap: removing container" podUID="f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" containerName="istio-proxy"
Oct 30 22:27:21.916557 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:21.916566    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" containerName="istio-proxy"
Oct 30 22:27:21.916930 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:21.916701    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="f9a572fa-5ae1-4e61-aa67-d2bf19dd4776" containerName="istio-proxy"
Oct 30 22:27:21.916930 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:21.916728    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="ebee4cde-8248-44a5-bba0-c6321764dec0" containerName="istio-proxy"
Oct 30 22:27:21.922070 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:21.922049    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"
Oct 30 22:27:21.981336 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:21.981301    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"]
Oct 30 22:27:22.035640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.025871    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w5-b7588a\""
Oct 30 22:27:22.035640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.026022    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w5-b7588a-dockercfg-b5q66\""
Oct 30 22:27:22.085628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.085559    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d647ad9-c005-4e6b-8451-83e8789c0bc8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx\" (UID: \"9d647ad9-c005-4e6b-8451-83e8789c0bc8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"
Oct 30 22:27:22.089614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.085837    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh6f9\" (UniqueName: \"kubernetes.io/projected/9d647ad9-c005-4e6b-8451-83e8789c0bc8-kube-api-access-fh6f9\") pod \"payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx\" (UID: \"9d647ad9-c005-4e6b-8451-83e8789c0bc8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"
Oct 30 22:27:22.191671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.187830    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d647ad9-c005-4e6b-8451-83e8789c0bc8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx\" (UID: \"9d647ad9-c005-4e6b-8451-83e8789c0bc8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"
Oct 30 22:27:22.191671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.188090    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh6f9\" (UniqueName: \"kubernetes.io/projected/9d647ad9-c005-4e6b-8451-83e8789c0bc8-kube-api-access-fh6f9\") pod \"payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx\" (UID: \"9d647ad9-c005-4e6b-8451-83e8789c0bc8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"
Oct 30 22:27:22.191671 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.189692    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d647ad9-c005-4e6b-8451-83e8789c0bc8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx\" (UID: \"9d647ad9-c005-4e6b-8451-83e8789c0bc8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"
Oct 30 22:27:22.237051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.237014    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"]
Oct 30 22:27:22.245861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.243940    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"
Oct 30 22:27:22.245861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.245760    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"]
Oct 30 22:27:22.253071 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.253036    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh6f9\" (UniqueName: \"kubernetes.io/projected/9d647ad9-c005-4e6b-8451-83e8789c0bc8-kube-api-access-fh6f9\") pod \"payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx\" (UID: \"9d647ad9-c005-4e6b-8451-83e8789c0bc8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"
Oct 30 22:27:22.391923 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.391885    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17a688d6-2e79-4018-9c79-fc505a28f9c6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l\" (UID: \"17a688d6-2e79-4018-9c79-fc505a28f9c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"
Oct 30 22:27:22.392111 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.392068    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcb7h\" (UniqueName: \"kubernetes.io/projected/17a688d6-2e79-4018-9c79-fc505a28f9c6-kube-api-access-vcb7h\") pod \"payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l\" (UID: \"17a688d6-2e79-4018-9c79-fc505a28f9c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"
Oct 30 22:27:22.494083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.494007    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17a688d6-2e79-4018-9c79-fc505a28f9c6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l\" (UID: \"17a688d6-2e79-4018-9c79-fc505a28f9c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"
Oct 30 22:27:22.494260 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.494086    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcb7h\" (UniqueName: \"kubernetes.io/projected/17a688d6-2e79-4018-9c79-fc505a28f9c6-kube-api-access-vcb7h\") pod \"payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l\" (UID: \"17a688d6-2e79-4018-9c79-fc505a28f9c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"
Oct 30 22:27:22.494761 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.494740    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17a688d6-2e79-4018-9c79-fc505a28f9c6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l\" (UID: \"17a688d6-2e79-4018-9c79-fc505a28f9c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"
Oct 30 22:27:22.553611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.544082    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"
Oct 30 22:27:22.596977 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.595491    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcb7h\" (UniqueName: \"kubernetes.io/projected/17a688d6-2e79-4018-9c79-fc505a28f9c6-kube-api-access-vcb7h\") pod \"payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l\" (UID: \"17a688d6-2e79-4018-9c79-fc505a28f9c6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"
Oct 30 22:27:22.881402 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:22.881362    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"
Oct 30 22:27:23.091343 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:23.091313    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"]
Oct 30 22:27:23.092714 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:27:23.092685    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d647ad9_c005_4e6b_8451_83e8789c0bc8.slice/crio-8eacc06ca16ffb10a5b6eeff5d5a8ba7a643212f052a44850fdda8134962e084 WatchSource:0}: Error finding container 8eacc06ca16ffb10a5b6eeff5d5a8ba7a643212f052a44850fdda8134962e084: Status 404 returned error can't find the container with id 8eacc06ca16ffb10a5b6eeff5d5a8ba7a643212f052a44850fdda8134962e084
Oct 30 22:27:23.267478 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:23.267446    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"]
Oct 30 22:27:23.268192 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:27:23.268145    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a688d6_2e79_4018_9c79_fc505a28f9c6.slice/crio-fe7236e1adcab048957b6c2fb5f368946fec5afca433cf125768dfe803a1e294 WatchSource:0}: Error finding container fe7236e1adcab048957b6c2fb5f368946fec5afca433cf125768dfe803a1e294: Status 404 returned error can't find the container with id fe7236e1adcab048957b6c2fb5f368946fec5afca433cf125768dfe803a1e294
Oct 30 22:27:24.011987 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:24.011948    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l" event={"ID":"17a688d6-2e79-4018-9c79-fc505a28f9c6","Type":"ContainerStarted","Data":"17b47a78f04ece93acd0acaf2eebb95e85e362d52db83d4d9392d2e22c6c1901"}
Oct 30 22:27:24.012477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:24.012006    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l" event={"ID":"17a688d6-2e79-4018-9c79-fc505a28f9c6","Type":"ContainerStarted","Data":"fe7236e1adcab048957b6c2fb5f368946fec5afca433cf125768dfe803a1e294"}
Oct 30 22:27:24.012477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:24.012031    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"
Oct 30 22:27:24.013643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:24.013616    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx" event={"ID":"9d647ad9-c005-4e6b-8451-83e8789c0bc8","Type":"ContainerStarted","Data":"244286c8189227c90ad07ebbe1bdddd2f7e7e47a187da35966529f7adb689089"}
Oct 30 22:27:24.013766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:24.013663    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx" event={"ID":"9d647ad9-c005-4e6b-8451-83e8789c0bc8","Type":"ContainerStarted","Data":"8eacc06ca16ffb10a5b6eeff5d5a8ba7a643212f052a44850fdda8134962e084"}
Oct 30 22:27:24.013766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:24.013702    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"
Oct 30 22:27:24.130639 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:24.130565    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l" podStartSLOduration=3.130552533 podStartE2EDuration="3.130552533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:27:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:27:24.129341471 +0000 UTC m=+1958.860198614" watchObservedRunningTime="2026-10-30 22:27:24.130552533 +0000 UTC m=+1958.861409709"
Oct 30 22:27:26.322841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:26.322806    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:26.650489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:26.650401    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:31.933127 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:31.933092    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:35.025382 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:35.025350    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"
Oct 30 22:27:35.025913 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:35.025431    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"
Oct 30 22:27:35.145014 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:35.144956    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx" podStartSLOduration=14.144940636 podStartE2EDuration="14.144940636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:27:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:27:24.271722139 +0000 UTC m=+1959.002579283" watchObservedRunningTime="2026-10-30 22:27:35.144940636 +0000 UTC m=+1969.875797839"
Oct 30 22:27:36.242437 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:36.242400    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:36.464985 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:36.464944    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:37.256236 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:37.256203    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:42.471771 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:42.471733    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:43.162773 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:27:43.162730    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:27:47.609386 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:47.609349    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:52.831239 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:52.831179    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:57.821959 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:27:57.821688    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:02.362545 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:02.362510    5258 generic.go:356] "Generic (PLEG): container finished" podID="e4139bcb-54a6-415d-961b-06d54e1894bc" containerID="0f396fa880c8a55ba0f1fd62d95b7dcf4408ab505c8211cdcb0b5e52acb6c052" exitCode=0
Oct 30 22:28:02.363029 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:02.362582    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m" event={"ID":"e4139bcb-54a6-415d-961b-06d54e1894bc","Type":"ContainerDied","Data":"0f396fa880c8a55ba0f1fd62d95b7dcf4408ab505c8211cdcb0b5e52acb6c052"}
Oct 30 22:28:02.363155 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:02.363133    5258 scope.go:122] "RemoveContainer" containerID="0f396fa880c8a55ba0f1fd62d95b7dcf4408ab505c8211cdcb0b5e52acb6c052"
Oct 30 22:28:02.364817 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:02.364789    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:28:02.364882 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:02.364858    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:28:02.364919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:02.364889    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:28:02.855057 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:02.855015    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:03.388186 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:03.388148    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m" event={"ID":"e4139bcb-54a6-415d-961b-06d54e1894bc","Type":"ContainerStarted","Data":"f17932207589176eba726015fff5aa7f0152e4b7f2e58feabf84ee2fe9821a0c"}
Oct 30 22:28:03.892668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:03.892632    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:28:03.893878 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:03.893849    5258 patch_prober.go:29] interesting pod/e2e-api-a-a42692-openshift-default-5898797997-vsb6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 22:28:03.894012 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:03.893902    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m" podUID="e4139bcb-54a6-415d-961b-06d54e1894bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 22:28:04.590022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:04.589988    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:04.666378 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:04.666343    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:28:04.811977 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:04.811944    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:04.893042 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:04.892945    5258 patch_prober.go:29] interesting pod/e2e-api-a-a42692-openshift-default-5898797997-vsb6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 22:28:04.893204 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:04.893033    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m" podUID="e4139bcb-54a6-415d-961b-06d54e1894bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 22:28:05.893060 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:05.893007    5258 patch_prober.go:29] interesting pod/e2e-api-a-a42692-openshift-default-5898797997-vsb6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 22:28:05.893654 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:05.893085    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m" podUID="e4139bcb-54a6-415d-961b-06d54e1894bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 22:28:06.893175 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:06.893134    5258 patch_prober.go:29] interesting pod/e2e-api-a-a42692-openshift-default-5898797997-vsb6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 22:28:06.893767 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:06.893198    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m" podUID="e4139bcb-54a6-415d-961b-06d54e1894bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 22:28:07.893473 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:07.893433    5258 patch_prober.go:29] interesting pod/e2e-api-a-a42692-openshift-default-5898797997-vsb6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 22:28:07.893904 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:07.893484    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m" podUID="e4139bcb-54a6-415d-961b-06d54e1894bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 22:28:08.094644 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:08.094571    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:08.897958 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:08.897922    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:28:08.899176 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:08.899154    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:28:12.737697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:12.737660    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"]
Oct 30 22:28:12.741611 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:12.741571    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:12.800959 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:12.800930    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w0-7fd7ba-serving-cert\""
Oct 30 22:28:12.847322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:12.847293    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3074c0ce-7879-4cf7-a334-5ea20dcffd01-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:12.847501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:12.847447    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:12.847572 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:12.847558    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:12.847672 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:12.847649    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5p5w\" (UniqueName: \"kubernetes.io/projected/3074c0ce-7879-4cf7-a334-5ea20dcffd01-kube-api-access-c5p5w\") pod \"maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:12.855468 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:12.855438    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"]
Oct 30 22:28:12.949443 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:12.949405    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:12.949653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:12.949499    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:12.949653 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:28:12.949517    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-serving-cert: secret "maas-api-e2e-shared-b-w0-7fd7ba-serving-cert" not found
Oct 30 22:28:12.949653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:12.949536    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5p5w\" (UniqueName: \"kubernetes.io/projected/3074c0ce-7879-4cf7-a334-5ea20dcffd01-kube-api-access-c5p5w\") pod \"maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:12.949888 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:28:12.949669    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-maas-api-tls podName:3074c0ce-7879-4cf7-a334-5ea20dcffd01 nodeName:}" failed. No retries permitted until 2026-10-30 22:28:13.449576399 +0000 UTC m=+2008.180433534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-maas-api-tls") pod "maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6" (UID: "3074c0ce-7879-4cf7-a334-5ea20dcffd01") : secret "maas-api-e2e-shared-b-w0-7fd7ba-serving-cert" not found
Oct 30 22:28:12.949975 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:12.949952    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3074c0ce-7879-4cf7-a334-5ea20dcffd01-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:12.950773 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:12.950744    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3074c0ce-7879-4cf7-a334-5ea20dcffd01-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:12.952540 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:12.952507    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:13.032567 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:13.032487    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5p5w\" (UniqueName: \"kubernetes.io/projected/3074c0ce-7879-4cf7-a334-5ea20dcffd01-kube-api-access-c5p5w\") pod \"maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:13.093998 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:13.093959    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:13.165393 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:28:13.165356    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:28:13.425133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:13.425097    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:13.458821 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:13.458790    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:13.461413 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:13.461388    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:13.659516 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:13.659473    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:14.052200 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:14.052163    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"]
Oct 30 22:28:14.053496 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:28:14.053459    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3074c0ce_7879_4cf7_a334_5ea20dcffd01.slice/crio-56226fb33999135a105533968a43a55d222dff3945a97d5718c0ce705a2bcd90 WatchSource:0}: Error finding container 56226fb33999135a105533968a43a55d222dff3945a97d5718c0ce705a2bcd90: Status 404 returned error can't find the container with id 56226fb33999135a105533968a43a55d222dff3945a97d5718c0ce705a2bcd90
Oct 30 22:28:14.484657 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:14.484611    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6" event={"ID":"3074c0ce-7879-4cf7-a334-5ea20dcffd01","Type":"ContainerStarted","Data":"56226fb33999135a105533968a43a55d222dff3945a97d5718c0ce705a2bcd90"}
Oct 30 22:28:15.498809 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:15.498761    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6" event={"ID":"3074c0ce-7879-4cf7-a334-5ea20dcffd01","Type":"ContainerStarted","Data":"059938af98429efbbd5dd2c5416ca6ad5e4ed186491856f61ca636ebdcd806cc"}
Oct 30 22:28:15.499810 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:15.499779    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:15.622505 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:15.622456    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6" podStartSLOduration=2.753537588 podStartE2EDuration="3.622441674s" totalImagesPullingTime="868.904086ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:28:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:28:15.617960066 +0000 UTC m=+2010.348817211" watchObservedRunningTime="2026-10-30 22:28:15.622441674 +0000 UTC m=+2010.353298817"
Oct 30 22:28:18.686765 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:18.686719    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:22.518666 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:22.518636    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:28:24.165658 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:24.165576    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:25.795950 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:25.795916    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"]
Oct 30 22:28:25.796395 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:25.796108    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" podUID="df963eee-a95d-438b-be00-94119985e1aa" containerName="istio-proxy" containerID="cri-o://1375ea864f7ef25b3cd331bf8e11caf0c6de20ccd33d1a4b4c56d953c050dd47" gracePeriod=30
Oct 30 22:28:26.988915 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:26.988875    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:28.164253 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:28.164220    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:28.455461 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:28.455370    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:29.183241 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:29.183203    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:29.955969 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:29.955933    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:28:29.956196 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:29.955995    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" podUID="df963eee-a95d-438b-be00-94119985e1aa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:28:31.084459 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.084431    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:28:31.142626 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.142558    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-workload-certs\") pod \"df963eee-a95d-438b-be00-94119985e1aa\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") "
Oct 30 22:28:31.142814 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.142704    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/df963eee-a95d-438b-be00-94119985e1aa-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df963eee-a95d-438b-be00-94119985e1aa-istiod-ca-cert\") pod \"df963eee-a95d-438b-be00-94119985e1aa\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") "
Oct 30 22:28:31.142814 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.142736    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-istio-envoy\") pod \"df963eee-a95d-438b-be00-94119985e1aa\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") "
Oct 30 22:28:31.142814 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.142774    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-credential-socket\") pod \"df963eee-a95d-438b-be00-94119985e1aa\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") "
Oct 30 22:28:31.142814 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.142807    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/df963eee-a95d-438b-be00-94119985e1aa-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df963eee-a95d-438b-be00-94119985e1aa-istio-podinfo\") pod \"df963eee-a95d-438b-be00-94119985e1aa\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") "
Oct 30 22:28:31.143048 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.142841    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-workload-certs" pod "df963eee-a95d-438b-be00-94119985e1aa" (UID: "df963eee-a95d-438b-be00-94119985e1aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:31.143048 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.142932    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df963eee-a95d-438b-be00-94119985e1aa-istio-token\" (UniqueName: \"kubernetes.io/projected/df963eee-a95d-438b-be00-94119985e1aa-istio-token\") pod \"df963eee-a95d-438b-be00-94119985e1aa\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") "
Oct 30 22:28:31.143048 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.142970    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-istio-data\") pod \"df963eee-a95d-438b-be00-94119985e1aa\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") "
Oct 30 22:28:31.143199 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.143099    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-credential-socket" pod "df963eee-a95d-438b-be00-94119985e1aa" (UID: "df963eee-a95d-438b-be00-94119985e1aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:31.143199 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.143137    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df963eee-a95d-438b-be00-94119985e1aa-istiod-ca-cert" pod "df963eee-a95d-438b-be00-94119985e1aa" (UID: "df963eee-a95d-438b-be00-94119985e1aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:28:31.143199 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.143145    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-workload-socket\") pod \"df963eee-a95d-438b-be00-94119985e1aa\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") "
Oct 30 22:28:31.143359 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.143238    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df963eee-a95d-438b-be00-94119985e1aa-kube-api-access-8j6xb\" (UniqueName: \"kubernetes.io/projected/df963eee-a95d-438b-be00-94119985e1aa-kube-api-access-8j6xb\") pod \"df963eee-a95d-438b-be00-94119985e1aa\" (UID: \"df963eee-a95d-438b-be00-94119985e1aa\") "
Oct 30 22:28:31.143412 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.143342    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-istio-data" pod "df963eee-a95d-438b-be00-94119985e1aa" (UID: "df963eee-a95d-438b-be00-94119985e1aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:31.143412 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.143358    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-workload-socket" pod "df963eee-a95d-438b-be00-94119985e1aa" (UID: "df963eee-a95d-438b-be00-94119985e1aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:31.144095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.144072    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:31.144095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.144097    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df963eee-a95d-438b-be00-94119985e1aa-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:31.144264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.144111    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:31.144264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.144125    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:31.144264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.144138    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:31.145500 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.145456    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-istio-envoy" pod "df963eee-a95d-438b-be00-94119985e1aa" (UID: "df963eee-a95d-438b-be00-94119985e1aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:31.145650 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.145545    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df963eee-a95d-438b-be00-94119985e1aa-istio-podinfo" pod "df963eee-a95d-438b-be00-94119985e1aa" (UID: "df963eee-a95d-438b-be00-94119985e1aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:28:31.145650 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.145617    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df963eee-a95d-438b-be00-94119985e1aa-istio-token" pod "df963eee-a95d-438b-be00-94119985e1aa" (UID: "df963eee-a95d-438b-be00-94119985e1aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:31.145766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.145737    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df963eee-a95d-438b-be00-94119985e1aa-kube-api-access-8j6xb" pod "df963eee-a95d-438b-be00-94119985e1aa" (UID: "df963eee-a95d-438b-be00-94119985e1aa"). InnerVolumeSpecName "kube-api-access-8j6xb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:31.245378 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.245345    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j6xb\" (UniqueName: \"kubernetes.io/projected/df963eee-a95d-438b-be00-94119985e1aa-kube-api-access-8j6xb\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:31.245541 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.245394    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df963eee-a95d-438b-be00-94119985e1aa-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:31.245541 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.245405    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df963eee-a95d-438b-be00-94119985e1aa-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:31.245541 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.245414    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df963eee-a95d-438b-be00-94119985e1aa-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:31.635583 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.635551    5258 generic.go:356] "Generic (PLEG): container finished" podID="df963eee-a95d-438b-be00-94119985e1aa" containerID="1375ea864f7ef25b3cd331bf8e11caf0c6de20ccd33d1a4b4c56d953c050dd47" exitCode=0
Oct 30 22:28:31.635800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.635623    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" event={"ID":"df963eee-a95d-438b-be00-94119985e1aa","Type":"ContainerDied","Data":"1375ea864f7ef25b3cd331bf8e11caf0c6de20ccd33d1a4b4c56d953c050dd47"}
Oct 30 22:28:31.635800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.635644    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"
Oct 30 22:28:31.635800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.635692    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s" event={"ID":"df963eee-a95d-438b-be00-94119985e1aa","Type":"ContainerDied","Data":"eed5b9ed59c9e4898ad835d23bca68f7c635bdc8b3b4afb5fee67170c2744d1d"}
Oct 30 22:28:31.635800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.635722    5258 scope.go:122] "RemoveContainer" containerID="1375ea864f7ef25b3cd331bf8e11caf0c6de20ccd33d1a4b4c56d953c050dd47"
Oct 30 22:28:31.646515 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.646492    5258 scope.go:122] "RemoveContainer" containerID="1375ea864f7ef25b3cd331bf8e11caf0c6de20ccd33d1a4b4c56d953c050dd47"
Oct 30 22:28:31.646823 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:28:31.646801    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1375ea864f7ef25b3cd331bf8e11caf0c6de20ccd33d1a4b4c56d953c050dd47\": container with ID starting with 1375ea864f7ef25b3cd331bf8e11caf0c6de20ccd33d1a4b4c56d953c050dd47 not found: ID does not exist" containerID="1375ea864f7ef25b3cd331bf8e11caf0c6de20ccd33d1a4b4c56d953c050dd47"
Oct 30 22:28:31.646882 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.646831    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1375ea864f7ef25b3cd331bf8e11caf0c6de20ccd33d1a4b4c56d953c050dd47"} err="failed to get container status \"1375ea864f7ef25b3cd331bf8e11caf0c6de20ccd33d1a4b4c56d953c050dd47\": rpc error: code = NotFound desc = could not find container \"1375ea864f7ef25b3cd331bf8e11caf0c6de20ccd33d1a4b4c56d953c050dd47\": container with ID starting with 1375ea864f7ef25b3cd331bf8e11caf0c6de20ccd33d1a4b4c56d953c050dd47 not found: ID does not exist"
Oct 30 22:28:31.803781 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.803745    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"]
Oct 30 22:28:31.810486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:31.810455    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-fn99s"]
Oct 30 22:28:33.383003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:33.382971    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="df963eee-a95d-438b-be00-94119985e1aa" path="/var/lib/kubelet/pods/df963eee-a95d-438b-be00-94119985e1aa/volumes"
Oct 30 22:28:34.062662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:34.062625    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:34.295390 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:34.295355    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:34.515553 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:34.515457    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:38.506916 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.506879    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"]
Oct 30 22:28:38.507482 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.507118    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz" podUID="e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b" containerName="maas-api" containerID="cri-o://426e88953c7583475107fc744f3a68f1486e44d0e27608a98f51f03d0fb00eec" gracePeriod=30
Oct 30 22:28:38.676297 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.676257    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:38.702111 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.702070    5258 generic.go:356] "Generic (PLEG): container finished" podID="e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b" containerID="426e88953c7583475107fc744f3a68f1486e44d0e27608a98f51f03d0fb00eec" exitCode=0
Oct 30 22:28:38.702279 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.702138    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz" event={"ID":"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b","Type":"ContainerDied","Data":"426e88953c7583475107fc744f3a68f1486e44d0e27608a98f51f03d0fb00eec"}
Oct 30 22:28:38.878760 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.878726    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:28:38.986634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.979379    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-metrics-certs\") pod \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") "
Oct 30 22:28:38.986634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.979504    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-kube-api-access-mkzk4\" (UniqueName: \"kubernetes.io/projected/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-kube-api-access-mkzk4\") pod \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") "
Oct 30 22:28:38.986634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.979692    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-openshift-service-ca\") pod \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") "
Oct 30 22:28:38.986634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.979725    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-maas-api-tls\") pod \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\" (UID: \"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b\") "
Oct 30 22:28:38.986634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.980740    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-openshift-service-ca" pod "e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b" (UID: "e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:28:38.986634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.981659    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:38.989572 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.989540    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-metrics-certs" pod "e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b" (UID: "e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:38.991839 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.991795    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-kube-api-access-mkzk4" pod "e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b" (UID: "e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b"). InnerVolumeSpecName "kube-api-access-mkzk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:38.995195 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:38.995161    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-maas-api-tls" pod "e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b" (UID: "e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:39.088445 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:39.088334    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:39.088708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:39.088685    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkzk4\" (UniqueName: \"kubernetes.io/projected/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-kube-api-access-mkzk4\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:39.088819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:39.088807    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:39.711473 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:39.711385    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"
Oct 30 22:28:39.711473 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:39.711411    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz" event={"ID":"e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b","Type":"ContainerDied","Data":"a8b8e1fc92b254ff203ccd32cdc5ca1309e43787d6b9d08f49975c4a976be4ba"}
Oct 30 22:28:39.712030 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:39.711485    5258 scope.go:122] "RemoveContainer" containerID="426e88953c7583475107fc744f3a68f1486e44d0e27608a98f51f03d0fb00eec"
Oct 30 22:28:39.880366 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:39.880328    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"]
Oct 30 22:28:39.934025 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:39.933984    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-2dd57a-57db5c55f9-pwxlz"]
Oct 30 22:28:40.292758 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:40.292707    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:40.578850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:40.578817    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:40.794216 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:40.794180    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:41.341141 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:41.341100    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:41.384172 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:41.384132    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b" path="/var/lib/kubelet/pods/e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b/volumes"
Oct 30 22:28:43.165741 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:28:43.165698    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:28:45.623034 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:45.622991    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:28:46.243813 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:46.243774    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:49.985685 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:49.985637    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:50.210765 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:50.210730    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:50.534612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:50.531253    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:51.056695 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.056662    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"]
Oct 30 22:28:51.057395 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.057380    5258 cpu_manager.go:414] "containerMap: removing container" podUID="df963eee-a95d-438b-be00-94119985e1aa" containerName="istio-proxy"
Oct 30 22:28:51.057442 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.057397    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df963eee-a95d-438b-be00-94119985e1aa" containerName="istio-proxy"
Oct 30 22:28:51.057442 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.057412    5258 cpu_manager.go:414] "containerMap: removing container" podUID="e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b" containerName="maas-api"
Oct 30 22:28:51.057442 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.057418    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b" containerName="maas-api"
Oct 30 22:28:51.057586 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.057575    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="df963eee-a95d-438b-be00-94119985e1aa" containerName="istio-proxy"
Oct 30 22:28:51.057586 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.057603    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="e7158d24-dbaa-46f4-a2a0-0a2ea1411f2b" containerName="maas-api"
Oct 30 22:28:51.062741 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.062710    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:51.125462 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.125436    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"]
Oct 30 22:28:51.155196 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.155166    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w5-b7588a-serving-cert\""
Oct 30 22:28:51.239644 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.239611    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:51.239819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.239740    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-metrics-certs\") pod \"maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:51.239988 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.239971    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj2x5\" (UniqueName: \"kubernetes.io/projected/01bd8649-238e-4741-8291-f634efc5139e-kube-api-access-zj2x5\") pod \"maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:51.240030 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.240006    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01bd8649-238e-4741-8291-f634efc5139e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:51.333713 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.333630    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:51.343691 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.342439    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj2x5\" (UniqueName: \"kubernetes.io/projected/01bd8649-238e-4741-8291-f634efc5139e-kube-api-access-zj2x5\") pod \"maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:51.343691 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.342510    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01bd8649-238e-4741-8291-f634efc5139e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:51.343691 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.342561    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:51.343691 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.342656    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-metrics-certs\") pod \"maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:51.343691 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.343394    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01bd8649-238e-4741-8291-f634efc5139e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:51.344077 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:28:51.343725    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-serving-cert: secret "maas-api-e2e-shared-b-w5-b7588a-serving-cert" not found
Oct 30 22:28:51.344077 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:28:51.343786    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-maas-api-tls podName:01bd8649-238e-4741-8291-f634efc5139e nodeName:}" failed. No retries permitted until 2026-10-30 22:28:51.843771631 +0000 UTC m=+2046.574628765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-maas-api-tls") pod "maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss" (UID: "01bd8649-238e-4741-8291-f634efc5139e") : secret "maas-api-e2e-shared-b-w5-b7588a-serving-cert" not found
Oct 30 22:28:51.350111 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.350072    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-metrics-certs\") pod \"maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:51.405694 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.405670    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj2x5\" (UniqueName: \"kubernetes.io/projected/01bd8649-238e-4741-8291-f634efc5139e-kube-api-access-zj2x5\") pod \"maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:51.566912 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.566869    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:51.800780 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.800683    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:51.850688 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.850649    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:51.853291 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.853269    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:51.976908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:51.976869    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:52.371385 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:28:52.371353    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01bd8649_238e_4741_8291_f634efc5139e.slice/crio-8b05c4ea1751c47ce40f7de0d51e16696c73261bb385701f68a1a89d2032beb4 WatchSource:0}: Error finding container 8b05c4ea1751c47ce40f7de0d51e16696c73261bb385701f68a1a89d2032beb4: Status 404 returned error can't find the container with id 8b05c4ea1751c47ce40f7de0d51e16696c73261bb385701f68a1a89d2032beb4
Oct 30 22:28:52.372133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:52.372107    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"]
Oct 30 22:28:52.836091 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:52.836043    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss" event={"ID":"01bd8649-238e-4741-8291-f634efc5139e","Type":"ContainerStarted","Data":"8b05c4ea1751c47ce40f7de0d51e16696c73261bb385701f68a1a89d2032beb4"}
Oct 30 22:28:53.394290 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:53.394248    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:53.619451 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:53.619416    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:53.849484 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:53.849449    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss" event={"ID":"01bd8649-238e-4741-8291-f634efc5139e","Type":"ContainerStarted","Data":"32beb2afd66f353ed4699e3c4b1c5a1af20754b5290632a7a8539de8c8bb5290"}
Oct 30 22:28:53.849703 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:53.849540    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:28:53.968625 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:53.968498    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss" podStartSLOduration=2.07278165 podStartE2EDuration="2.968480812s" totalImagesPullingTime="895.699162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:28:53.967381077 +0000 UTC m=+2048.698238221" watchObservedRunningTime="2026-10-30 22:28:53.968480812 +0000 UTC m=+2048.699337956"
Oct 30 22:28:57.181701 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:57.180620    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:59.863422 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:28:59.863383    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:29:02.577982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:02.577944    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:03.850543 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:03.850506    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:04.075707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:04.075672    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:08.027636 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:08.027583    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:13.051021 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:13.050980    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:13.162419 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:29:13.162375    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:29:18.126872 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:18.126780    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:23.365640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:23.365601    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:24.813742 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:24.813705    5258 patch_prober.go:29] interesting pod/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:29:24.814268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:24.813841    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k" podUID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:29:26.056935 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:26.056902    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"]
Oct 30 22:29:26.057424 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:26.057085    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy" containerID="cri-o://a9784b79cbfcb0962df85ac9611c63496f47f691d40c039cb02587ace88299f3" gracePeriod=30
Oct 30 22:29:26.106439 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:26.106410    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"]
Oct 30 22:29:26.106636 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:26.106613    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8" podUID="1eb38bdf-2e27-4229-9670-dc3230d6e7fd" containerName="istio-proxy" containerID="cri-o://9501f98c1948762a4d7ac8cfc4d3f7edab271d69e7a699aaca1f2228f7366efd" gracePeriod=30
Oct 30 22:29:26.209869 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:26.209839    5258 generic.go:356] "Generic (PLEG): container finished" podID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerID="ec3296d8e7e4ca39d4c55ae9bee5c6357ba9375afb937b395f2cd0ea60013a87" exitCode=0
Oct 30 22:29:26.210035 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:26.209915    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k" event={"ID":"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8","Type":"ContainerDied","Data":"ec3296d8e7e4ca39d4c55ae9bee5c6357ba9375afb937b395f2cd0ea60013a87"}
Oct 30 22:29:26.210367 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:26.210344    5258 scope.go:122] "RemoveContainer" containerID="ec3296d8e7e4ca39d4c55ae9bee5c6357ba9375afb937b395f2cd0ea60013a87"
Oct 30 22:29:26.212054 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:26.212025    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:29:26.212145 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:26.212096    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:29:26.212145 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:26.212127    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:29:27.219791 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:27.219755    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k" event={"ID":"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8","Type":"ContainerStarted","Data":"f3ebe3a1209b98c3f7c6c92f463b4a67b834355d65d6946a1d255375def88ca6"}
Oct 30 22:29:27.367613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:27.365222    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:27.692477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:27.690893    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:29:27.692477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:27.691211    5258 patch_prober.go:29] interesting pod/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 22:29:27.692477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:27.691266    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k" podUID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 22:29:28.693638 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:28.692575    5258 patch_prober.go:29] interesting pod/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 22:29:28.693638 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:28.692659    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k" podUID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 22:29:29.435795 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:29.435753    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:29.676615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:29.676018    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:29.690695 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:29.690615    5258 patch_prober.go:29] interesting pod/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 22:29:29.690695 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:29.690667    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k" podUID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 22:29:29.924101 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:29.924062    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:30.449064 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:30.449030    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:30.690144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:30.690103    5258 patch_prober.go:29] interesting pod/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 22:29:30.690338 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:30.690170    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k" podUID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 22:29:31.254630 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.251760    5258 generic.go:356] "Generic (PLEG): container finished" podID="56977125-2b70-474b-b9a6-f0573841b207" containerID="a9784b79cbfcb0962df85ac9611c63496f47f691d40c039cb02587ace88299f3" exitCode=0
Oct 30 22:29:31.254630 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.251861    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" event={"ID":"56977125-2b70-474b-b9a6-f0573841b207","Type":"ContainerDied","Data":"a9784b79cbfcb0962df85ac9611c63496f47f691d40c039cb02587ace88299f3"}
Oct 30 22:29:31.281616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.270565    5258 generic.go:356] "Generic (PLEG): container finished" podID="1eb38bdf-2e27-4229-9670-dc3230d6e7fd" containerID="9501f98c1948762a4d7ac8cfc4d3f7edab271d69e7a699aaca1f2228f7366efd" exitCode=0
Oct 30 22:29:31.281616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.270825    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8" event={"ID":"1eb38bdf-2e27-4229-9670-dc3230d6e7fd","Type":"ContainerDied","Data":"9501f98c1948762a4d7ac8cfc4d3f7edab271d69e7a699aaca1f2228f7366efd"}
Oct 30 22:29:31.439871 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.439844    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:29:31.521680 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.521643    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-envoy\") pod \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") "
Oct 30 22:29:31.521868 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.521748    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istiod-ca-cert\") pod \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") "
Oct 30 22:29:31.521868 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.521789    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-workload-socket\") pod \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") "
Oct 30 22:29:31.521868 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.521817    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-token\" (UniqueName: \"kubernetes.io/projected/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-token\") pod \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") "
Oct 30 22:29:31.521868 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.521844    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-podinfo\") pod \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") "
Oct 30 22:29:31.522153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.522024    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-workload-certs\") pod \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") "
Oct 30 22:29:31.522153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.522137    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istiod-ca-cert" pod "1eb38bdf-2e27-4229-9670-dc3230d6e7fd" (UID: "1eb38bdf-2e27-4229-9670-dc3230d6e7fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:29:31.522260 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.522170    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-kube-api-access-2dpdm\" (UniqueName: \"kubernetes.io/projected/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-kube-api-access-2dpdm\") pod \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") "
Oct 30 22:29:31.522260 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.522205    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-credential-socket\") pod \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") "
Oct 30 22:29:31.522367 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.522311    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-data\") pod \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\" (UID: \"1eb38bdf-2e27-4229-9670-dc3230d6e7fd\") "
Oct 30 22:29:31.522463 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.522435    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-workload-certs" pod "1eb38bdf-2e27-4229-9670-dc3230d6e7fd" (UID: "1eb38bdf-2e27-4229-9670-dc3230d6e7fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:31.522689 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.522667    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-credential-socket" pod "1eb38bdf-2e27-4229-9670-dc3230d6e7fd" (UID: "1eb38bdf-2e27-4229-9670-dc3230d6e7fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:31.522808 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.522784    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-data" pod "1eb38bdf-2e27-4229-9670-dc3230d6e7fd" (UID: "1eb38bdf-2e27-4229-9670-dc3230d6e7fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:31.522859 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.522806    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-workload-socket" pod "1eb38bdf-2e27-4229-9670-dc3230d6e7fd" (UID: "1eb38bdf-2e27-4229-9670-dc3230d6e7fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:31.522991 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.522971    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:31.523059 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.522999    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:31.523059 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.523017    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:31.523059 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.523033    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:31.523059 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.523047    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:31.524240 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.524213    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-podinfo" pod "1eb38bdf-2e27-4229-9670-dc3230d6e7fd" (UID: "1eb38bdf-2e27-4229-9670-dc3230d6e7fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:29:31.524334 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.524277    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-token" pod "1eb38bdf-2e27-4229-9670-dc3230d6e7fd" (UID: "1eb38bdf-2e27-4229-9670-dc3230d6e7fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:31.524616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.524572    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-envoy" pod "1eb38bdf-2e27-4229-9670-dc3230d6e7fd" (UID: "1eb38bdf-2e27-4229-9670-dc3230d6e7fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:31.524683 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.524612    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-kube-api-access-2dpdm" pod "1eb38bdf-2e27-4229-9670-dc3230d6e7fd" (UID: "1eb38bdf-2e27-4229-9670-dc3230d6e7fd"). InnerVolumeSpecName "kube-api-access-2dpdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:31.624719 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.624352    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dpdm\" (UniqueName: \"kubernetes.io/projected/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-kube-api-access-2dpdm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:31.624719 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.624392    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:31.624719 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.624408    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:31.624719 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.624420    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb38bdf-2e27-4229-9670-dc3230d6e7fd-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:31.692641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.692217    5258 patch_prober.go:29] interesting pod/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused" start-of-body=
Oct 30 22:29:31.692641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.692286    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k" podUID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.128:15021/healthz/ready\": dial tcp 10.132.0.128:15021: connect: connection refused"
Oct 30 22:29:31.901315 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.901287    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:29:31.946986 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.946918    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-workload-certs\") pod \"56977125-2b70-474b-b9a6-f0573841b207\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") "
Oct 30 22:29:31.946986 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.946951    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-workload-socket\") pod \"56977125-2b70-474b-b9a6-f0573841b207\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") "
Oct 30 22:29:31.947148 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.947008    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-credential-socket\") pod \"56977125-2b70-474b-b9a6-f0573841b207\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") "
Oct 30 22:29:31.947148 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.947047    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-istio-envoy\") pod \"56977125-2b70-474b-b9a6-f0573841b207\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") "
Oct 30 22:29:31.947148 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.947119    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56977125-2b70-474b-b9a6-f0573841b207-istio-token\" (UniqueName: \"kubernetes.io/projected/56977125-2b70-474b-b9a6-f0573841b207-istio-token\") pod \"56977125-2b70-474b-b9a6-f0573841b207\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") "
Oct 30 22:29:31.947247 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.947236    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-istio-data\") pod \"56977125-2b70-474b-b9a6-f0573841b207\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") "
Oct 30 22:29:31.947285 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.947219    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-workload-certs" pod "56977125-2b70-474b-b9a6-f0573841b207" (UID: "56977125-2b70-474b-b9a6-f0573841b207"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:31.947285 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.947278    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/56977125-2b70-474b-b9a6-f0573841b207-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56977125-2b70-474b-b9a6-f0573841b207-istio-podinfo\") pod \"56977125-2b70-474b-b9a6-f0573841b207\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") "
Oct 30 22:29:31.947349 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.947327    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/56977125-2b70-474b-b9a6-f0573841b207-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56977125-2b70-474b-b9a6-f0573841b207-istiod-ca-cert\") pod \"56977125-2b70-474b-b9a6-f0573841b207\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") "
Oct 30 22:29:31.947349 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.947279    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-credential-socket" pod "56977125-2b70-474b-b9a6-f0573841b207" (UID: "56977125-2b70-474b-b9a6-f0573841b207"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:31.947410 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.947324    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-workload-socket" pod "56977125-2b70-474b-b9a6-f0573841b207" (UID: "56977125-2b70-474b-b9a6-f0573841b207"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:31.947410 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.947380    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56977125-2b70-474b-b9a6-f0573841b207-kube-api-access-fkkc2\" (UniqueName: \"kubernetes.io/projected/56977125-2b70-474b-b9a6-f0573841b207-kube-api-access-fkkc2\") pod \"56977125-2b70-474b-b9a6-f0573841b207\" (UID: \"56977125-2b70-474b-b9a6-f0573841b207\") "
Oct 30 22:29:31.947475 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.947438    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-istio-data" pod "56977125-2b70-474b-b9a6-f0573841b207" (UID: "56977125-2b70-474b-b9a6-f0573841b207"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:31.947757 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.947730    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56977125-2b70-474b-b9a6-f0573841b207-istiod-ca-cert" pod "56977125-2b70-474b-b9a6-f0573841b207" (UID: "56977125-2b70-474b-b9a6-f0573841b207"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:29:31.948118 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.948099    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:31.948221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.948122    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:31.948221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.948136    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56977125-2b70-474b-b9a6-f0573841b207-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:31.948221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.948151    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:31.948221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.948165    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:31.949899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.949872    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56977125-2b70-474b-b9a6-f0573841b207-istio-podinfo" pod "56977125-2b70-474b-b9a6-f0573841b207" (UID: "56977125-2b70-474b-b9a6-f0573841b207"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:29:31.950023 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.950001    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56977125-2b70-474b-b9a6-f0573841b207-istio-token" pod "56977125-2b70-474b-b9a6-f0573841b207" (UID: "56977125-2b70-474b-b9a6-f0573841b207"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:31.950083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.950064    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56977125-2b70-474b-b9a6-f0573841b207-kube-api-access-fkkc2" pod "56977125-2b70-474b-b9a6-f0573841b207" (UID: "56977125-2b70-474b-b9a6-f0573841b207"). InnerVolumeSpecName "kube-api-access-fkkc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:31.950133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:31.950067    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-istio-envoy" pod "56977125-2b70-474b-b9a6-f0573841b207" (UID: "56977125-2b70-474b-b9a6-f0573841b207"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:32.049867 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.049829    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56977125-2b70-474b-b9a6-f0573841b207-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:32.049867 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.049866    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56977125-2b70-474b-b9a6-f0573841b207-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:32.050068 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.049880    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkkc2\" (UniqueName: \"kubernetes.io/projected/56977125-2b70-474b-b9a6-f0573841b207-kube-api-access-fkkc2\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:32.050068 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.049894    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56977125-2b70-474b-b9a6-f0573841b207-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:32.290316 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.290219    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"
Oct 30 22:29:32.290959 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.290237    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8" event={"ID":"56977125-2b70-474b-b9a6-f0573841b207","Type":"ContainerDied","Data":"643267f7824f78d3b388674955969c8edd1d669841c64c13505b1596fc17eb42"}
Oct 30 22:29:32.291124 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.291018    5258 scope.go:122] "RemoveContainer" containerID="a9784b79cbfcb0962df85ac9611c63496f47f691d40c039cb02587ace88299f3"
Oct 30 22:29:32.292853 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.292608    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"
Oct 30 22:29:32.292853 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.292667    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8" event={"ID":"1eb38bdf-2e27-4229-9670-dc3230d6e7fd","Type":"ContainerDied","Data":"3c0840e629ec2e1e87439758f865bdaada5f62c7f4510d44655f91ed6b5dbcdb"}
Oct 30 22:29:32.306064 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.305316    5258 scope.go:122] "RemoveContainer" containerID="9501f98c1948762a4d7ac8cfc4d3f7edab271d69e7a699aaca1f2228f7366efd"
Oct 30 22:29:32.482619 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.482565    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"]
Oct 30 22:29:32.528953 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.528922    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-kmzp8"]
Oct 30 22:29:32.604111 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.604075    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"]
Oct 30 22:29:32.607857 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.607830    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-vnjq8"]
Oct 30 22:29:32.695265 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.695236    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:29:32.695649 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.695625    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:29:32.696380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:32.696363    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:29:33.385816 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:33.385780    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1eb38bdf-2e27-4229-9670-dc3230d6e7fd" path="/var/lib/kubelet/pods/1eb38bdf-2e27-4229-9670-dc3230d6e7fd/volumes"
Oct 30 22:29:33.386573 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:33.386545    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="56977125-2b70-474b-b9a6-f0573841b207" path="/var/lib/kubelet/pods/56977125-2b70-474b-b9a6-f0573841b207/volumes"
Oct 30 22:29:35.297278 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:35.297245    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:38.160064 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:38.160024    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:38.380683 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:38.380649    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:38.491893 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:38.491810    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"]
Oct 30 22:29:38.609079 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:38.607454    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:39.354500 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:39.354463    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m" podUID="e4139bcb-54a6-415d-961b-06d54e1894bc" containerName="istio-proxy" containerID="cri-o://f17932207589176eba726015fff5aa7f0152e4b7f2e58feabf84ee2fe9821a0c" gracePeriod=30
Oct 30 22:29:40.669395 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:40.669350    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:40.909155 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:40.909118    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:43.162086 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:29:43.162052    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:29:44.653383 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.653359    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:29:44.670749 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.670723    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e4139bcb-54a6-415d-961b-06d54e1894bc-kube-api-access-vfhmj\" (UniqueName: \"kubernetes.io/projected/e4139bcb-54a6-415d-961b-06d54e1894bc-kube-api-access-vfhmj\") pod \"e4139bcb-54a6-415d-961b-06d54e1894bc\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") "
Oct 30 22:29:44.670906 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.670790    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-credential-socket\") pod \"e4139bcb-54a6-415d-961b-06d54e1894bc\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") "
Oct 30 22:29:44.670906 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.670825    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-workload-socket\") pod \"e4139bcb-54a6-415d-961b-06d54e1894bc\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") "
Oct 30 22:29:44.670906 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.670855    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-podinfo\") pod \"e4139bcb-54a6-415d-961b-06d54e1894bc\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") "
Oct 30 22:29:44.670906 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.670879    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-workload-certs\") pod \"e4139bcb-54a6-415d-961b-06d54e1894bc\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") "
Oct 30 22:29:44.671155 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.670929    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-token\" (UniqueName: \"kubernetes.io/projected/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-token\") pod \"e4139bcb-54a6-415d-961b-06d54e1894bc\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") "
Oct 30 22:29:44.671155 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.670961    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-data\") pod \"e4139bcb-54a6-415d-961b-06d54e1894bc\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") "
Oct 30 22:29:44.671155 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.671012    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-credential-socket" pod "e4139bcb-54a6-415d-961b-06d54e1894bc" (UID: "e4139bcb-54a6-415d-961b-06d54e1894bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:44.671287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.671157    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-envoy\") pod \"e4139bcb-54a6-415d-961b-06d54e1894bc\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") "
Oct 30 22:29:44.671287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.671162    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-workload-certs" pod "e4139bcb-54a6-415d-961b-06d54e1894bc" (UID: "e4139bcb-54a6-415d-961b-06d54e1894bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:44.671287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.671188    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e4139bcb-54a6-415d-961b-06d54e1894bc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4139bcb-54a6-415d-961b-06d54e1894bc-istiod-ca-cert\") pod \"e4139bcb-54a6-415d-961b-06d54e1894bc\" (UID: \"e4139bcb-54a6-415d-961b-06d54e1894bc\") "
Oct 30 22:29:44.671448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.671302    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-data" pod "e4139bcb-54a6-415d-961b-06d54e1894bc" (UID: "e4139bcb-54a6-415d-961b-06d54e1894bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:44.671580 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.671554    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4139bcb-54a6-415d-961b-06d54e1894bc-istiod-ca-cert" pod "e4139bcb-54a6-415d-961b-06d54e1894bc" (UID: "e4139bcb-54a6-415d-961b-06d54e1894bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:29:44.671693 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.671671    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-workload-socket" pod "e4139bcb-54a6-415d-961b-06d54e1894bc" (UID: "e4139bcb-54a6-415d-961b-06d54e1894bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:44.671977 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.671958    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4139bcb-54a6-415d-961b-06d54e1894bc-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:44.672075 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.671980    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:44.672075 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.671997    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:44.672075 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.672011    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:44.672075 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.672024    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:44.673177 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.673151    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4139bcb-54a6-415d-961b-06d54e1894bc-kube-api-access-vfhmj" pod "e4139bcb-54a6-415d-961b-06d54e1894bc" (UID: "e4139bcb-54a6-415d-961b-06d54e1894bc"). InnerVolumeSpecName "kube-api-access-vfhmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:44.673295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.673213    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-token" pod "e4139bcb-54a6-415d-961b-06d54e1894bc" (UID: "e4139bcb-54a6-415d-961b-06d54e1894bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:44.673530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.673513    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-envoy" pod "e4139bcb-54a6-415d-961b-06d54e1894bc" (UID: "e4139bcb-54a6-415d-961b-06d54e1894bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:44.673578 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.673548    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-podinfo" pod "e4139bcb-54a6-415d-961b-06d54e1894bc" (UID: "e4139bcb-54a6-415d-961b-06d54e1894bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:29:44.773494 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.773452    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:44.773494 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.773487    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfhmj\" (UniqueName: \"kubernetes.io/projected/e4139bcb-54a6-415d-961b-06d54e1894bc-kube-api-access-vfhmj\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:44.773756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.773503    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:44.773756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:44.773517    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4139bcb-54a6-415d-961b-06d54e1894bc-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:45.410175 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.410143    5258 generic.go:356] "Generic (PLEG): container finished" podID="e4139bcb-54a6-415d-961b-06d54e1894bc" containerID="f17932207589176eba726015fff5aa7f0152e4b7f2e58feabf84ee2fe9821a0c" exitCode=0
Oct 30 22:29:45.410317 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.410206    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"
Oct 30 22:29:45.410317 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.410220    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m" event={"ID":"e4139bcb-54a6-415d-961b-06d54e1894bc","Type":"ContainerDied","Data":"f17932207589176eba726015fff5aa7f0152e4b7f2e58feabf84ee2fe9821a0c"}
Oct 30 22:29:45.410317 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.410269    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m" event={"ID":"e4139bcb-54a6-415d-961b-06d54e1894bc","Type":"ContainerDied","Data":"70381ff3b5cfd154d817a9a10c0934f92fe8922347988baddb90fd4f1ac26657"}
Oct 30 22:29:45.410317 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.410296    5258 scope.go:122] "RemoveContainer" containerID="f17932207589176eba726015fff5aa7f0152e4b7f2e58feabf84ee2fe9821a0c"
Oct 30 22:29:45.422073 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.422054    5258 scope.go:122] "RemoveContainer" containerID="0f396fa880c8a55ba0f1fd62d95b7dcf4408ab505c8211cdcb0b5e52acb6c052"
Oct 30 22:29:45.432337 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.432318    5258 scope.go:122] "RemoveContainer" containerID="f17932207589176eba726015fff5aa7f0152e4b7f2e58feabf84ee2fe9821a0c"
Oct 30 22:29:45.432598 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:29:45.432567    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f17932207589176eba726015fff5aa7f0152e4b7f2e58feabf84ee2fe9821a0c\": container with ID starting with f17932207589176eba726015fff5aa7f0152e4b7f2e58feabf84ee2fe9821a0c not found: ID does not exist" containerID="f17932207589176eba726015fff5aa7f0152e4b7f2e58feabf84ee2fe9821a0c"
Oct 30 22:29:45.432659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.432609    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f17932207589176eba726015fff5aa7f0152e4b7f2e58feabf84ee2fe9821a0c"} err="failed to get container status \"f17932207589176eba726015fff5aa7f0152e4b7f2e58feabf84ee2fe9821a0c\": rpc error: code = NotFound desc = could not find container \"f17932207589176eba726015fff5aa7f0152e4b7f2e58feabf84ee2fe9821a0c\": container with ID starting with f17932207589176eba726015fff5aa7f0152e4b7f2e58feabf84ee2fe9821a0c not found: ID does not exist"
Oct 30 22:29:45.432659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.432627    5258 scope.go:122] "RemoveContainer" containerID="0f396fa880c8a55ba0f1fd62d95b7dcf4408ab505c8211cdcb0b5e52acb6c052"
Oct 30 22:29:45.432854 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:29:45.432835    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f396fa880c8a55ba0f1fd62d95b7dcf4408ab505c8211cdcb0b5e52acb6c052\": container with ID starting with 0f396fa880c8a55ba0f1fd62d95b7dcf4408ab505c8211cdcb0b5e52acb6c052 not found: ID does not exist" containerID="0f396fa880c8a55ba0f1fd62d95b7dcf4408ab505c8211cdcb0b5e52acb6c052"
Oct 30 22:29:45.432896 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.432859    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f396fa880c8a55ba0f1fd62d95b7dcf4408ab505c8211cdcb0b5e52acb6c052"} err="failed to get container status \"0f396fa880c8a55ba0f1fd62d95b7dcf4408ab505c8211cdcb0b5e52acb6c052\": rpc error: code = NotFound desc = could not find container \"0f396fa880c8a55ba0f1fd62d95b7dcf4408ab505c8211cdcb0b5e52acb6c052\": container with ID starting with 0f396fa880c8a55ba0f1fd62d95b7dcf4408ab505c8211cdcb0b5e52acb6c052 not found: ID does not exist"
Oct 30 22:29:45.619200 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.619163    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"]
Oct 30 22:29:45.631597 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.631554    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"]
Oct 30 22:29:45.669250 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.669166    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a42692-openshift-default-5898797997-vsb6m"]
Oct 30 22:29:45.674103 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.674057    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"]
Oct 30 22:29:45.726454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.726424    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:29:45.728355 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.728331    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:29:45.807642 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:45.807571    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:46.323809 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:46.320268    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:47.384344 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:47.384310    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e4139bcb-54a6-415d-961b-06d54e1894bc" path="/var/lib/kubelet/pods/e4139bcb-54a6-415d-961b-06d54e1894bc/volumes"
Oct 30 22:29:51.848033 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:51.847998    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:52.855659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:52.855625    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:53.088509 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:53.088470    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:55.324131 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:55.324096    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:55.548504 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:55.548462    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:56.647256 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:56.647211    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:29:57.496455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:29:57.496417    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:00.287570 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.287529    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"]
Oct 30 22:30:00.288252 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.288232    5258 cpu_manager.go:414] "containerMap: removing container" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy"
Oct 30 22:30:00.288252 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.288251    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy"
Oct 30 22:30:00.288409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.288274    5258 cpu_manager.go:414] "containerMap: removing container" podUID="1eb38bdf-2e27-4229-9670-dc3230d6e7fd" containerName="istio-proxy"
Oct 30 22:30:00.288409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.288279    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1eb38bdf-2e27-4229-9670-dc3230d6e7fd" containerName="istio-proxy"
Oct 30 22:30:00.288409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.288294    5258 cpu_manager.go:414] "containerMap: removing container" podUID="e4139bcb-54a6-415d-961b-06d54e1894bc" containerName="istio-proxy"
Oct 30 22:30:00.288409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.288299    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e4139bcb-54a6-415d-961b-06d54e1894bc" containerName="istio-proxy"
Oct 30 22:30:00.288409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.288311    5258 cpu_manager.go:414] "containerMap: removing container" podUID="e4139bcb-54a6-415d-961b-06d54e1894bc" containerName="istio-proxy"
Oct 30 22:30:00.288409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.288316    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e4139bcb-54a6-415d-961b-06d54e1894bc" containerName="istio-proxy"
Oct 30 22:30:00.288740 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.288440    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="56977125-2b70-474b-b9a6-f0573841b207" containerName="istio-proxy"
Oct 30 22:30:00.288740 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.288452    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="1eb38bdf-2e27-4229-9670-dc3230d6e7fd" containerName="istio-proxy"
Oct 30 22:30:00.288740 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.288460    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="e4139bcb-54a6-415d-961b-06d54e1894bc" containerName="istio-proxy"
Oct 30 22:30:00.293968 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.293944    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"
Oct 30 22:30:00.320505 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.320480    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"]
Oct 30 22:30:00.326812 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.326790    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="e4139bcb-54a6-415d-961b-06d54e1894bc" containerName="istio-proxy"
Oct 30 22:30:00.333855 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.333830    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"
Oct 30 22:30:00.334020 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.333997    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"]
Oct 30 22:30:00.339092 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.339073    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"
Oct 30 22:30:00.374556 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.374527    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"]
Oct 30 22:30:00.381861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.381836    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"]
Oct 30 22:30:00.409859 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.409826    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4q4x\" (UniqueName: \"kubernetes.io/projected/e05348d0-23b5-49d1-8171-17f2ccbcd41a-kube-api-access-t4q4x\") pod \"maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf\" (UID: \"e05348d0-23b5-49d1-8171-17f2ccbcd41a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"
Oct 30 22:30:00.410021 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.410005    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e05348d0-23b5-49d1-8171-17f2ccbcd41a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf\" (UID: \"e05348d0-23b5-49d1-8171-17f2ccbcd41a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"
Oct 30 22:30:00.445483 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.445455    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l4mjj\""
Oct 30 22:30:00.445702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.445452    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:30:00.446395 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.446372    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"]
Oct 30 22:30:00.511501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.511468    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4q4x\" (UniqueName: \"kubernetes.io/projected/e05348d0-23b5-49d1-8171-17f2ccbcd41a-kube-api-access-t4q4x\") pod \"maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf\" (UID: \"e05348d0-23b5-49d1-8171-17f2ccbcd41a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"
Oct 30 22:30:00.511685 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.511510    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pscv9\" (UniqueName: \"kubernetes.io/projected/769ff87d-8eca-48b8-ae57-27d2347ba07d-kube-api-access-pscv9\") pod \"maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf\" (UID: \"769ff87d-8eca-48b8-ae57-27d2347ba07d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"
Oct 30 22:30:00.511685 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.511558    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wfj2\" (UniqueName: \"kubernetes.io/projected/0685291a-5d96-43e4-86e8-70fe359214b4-kube-api-access-8wfj2\") pod \"maas-api-revoke-keys-e2e-api-a-56c628-846jh\" (UID: \"0685291a-5d96-43e4-86e8-70fe359214b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"
Oct 30 22:30:00.511685 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.511584    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/769ff87d-8eca-48b8-ae57-27d2347ba07d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf\" (UID: \"769ff87d-8eca-48b8-ae57-27d2347ba07d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"
Oct 30 22:30:00.511893 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.511786    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0685291a-5d96-43e4-86e8-70fe359214b4-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-api-a-56c628-846jh\" (UID: \"0685291a-5d96-43e4-86e8-70fe359214b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"
Oct 30 22:30:00.511893 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.511861    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e05348d0-23b5-49d1-8171-17f2ccbcd41a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf\" (UID: \"e05348d0-23b5-49d1-8171-17f2ccbcd41a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"
Oct 30 22:30:00.511970 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.511931    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0685291a-5d96-43e4-86e8-70fe359214b4-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-api-a-56c628-846jh\" (UID: \"0685291a-5d96-43e4-86e8-70fe359214b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"
Oct 30 22:30:00.512531 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.512513    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e05348d0-23b5-49d1-8171-17f2ccbcd41a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf\" (UID: \"e05348d0-23b5-49d1-8171-17f2ccbcd41a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"
Oct 30 22:30:00.573437 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.573404    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4q4x\" (UniqueName: \"kubernetes.io/projected/e05348d0-23b5-49d1-8171-17f2ccbcd41a-kube-api-access-t4q4x\") pod \"maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf\" (UID: \"e05348d0-23b5-49d1-8171-17f2ccbcd41a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"
Oct 30 22:30:00.613669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.613634    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0685291a-5d96-43e4-86e8-70fe359214b4-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-api-a-56c628-846jh\" (UID: \"0685291a-5d96-43e4-86e8-70fe359214b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"
Oct 30 22:30:00.613836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.613766    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"
Oct 30 22:30:00.613836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.613810    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pscv9\" (UniqueName: \"kubernetes.io/projected/769ff87d-8eca-48b8-ae57-27d2347ba07d-kube-api-access-pscv9\") pod \"maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf\" (UID: \"769ff87d-8eca-48b8-ae57-27d2347ba07d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"
Oct 30 22:30:00.613989 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.613893    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wfj2\" (UniqueName: \"kubernetes.io/projected/0685291a-5d96-43e4-86e8-70fe359214b4-kube-api-access-8wfj2\") pod \"maas-api-revoke-keys-e2e-api-a-56c628-846jh\" (UID: \"0685291a-5d96-43e4-86e8-70fe359214b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"
Oct 30 22:30:00.613989 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.613934    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/769ff87d-8eca-48b8-ae57-27d2347ba07d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf\" (UID: \"769ff87d-8eca-48b8-ae57-27d2347ba07d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"
Oct 30 22:30:00.614122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.614026    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0685291a-5d96-43e4-86e8-70fe359214b4-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-api-a-56c628-846jh\" (UID: \"0685291a-5d96-43e4-86e8-70fe359214b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"
Oct 30 22:30:00.614898 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.614874    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/769ff87d-8eca-48b8-ae57-27d2347ba07d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf\" (UID: \"769ff87d-8eca-48b8-ae57-27d2347ba07d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"
Oct 30 22:30:00.614898 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.614883    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0685291a-5d96-43e4-86e8-70fe359214b4-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-api-a-56c628-846jh\" (UID: \"0685291a-5d96-43e4-86e8-70fe359214b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"
Oct 30 22:30:00.615988 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.615961    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0685291a-5d96-43e4-86e8-70fe359214b4-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-api-a-56c628-846jh\" (UID: \"0685291a-5d96-43e4-86e8-70fe359214b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"
Oct 30 22:30:00.641399 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.641349    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main" containerID="cri-o://e08b8e0434caeeea9ae1ba7369cf0dbc5ac5aaa8ea8ef35e16e1e5484a455991" gracePeriod=45
Oct 30 22:30:00.686429 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.686335    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pscv9\" (UniqueName: \"kubernetes.io/projected/769ff87d-8eca-48b8-ae57-27d2347ba07d-kube-api-access-pscv9\") pod \"maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf\" (UID: \"769ff87d-8eca-48b8-ae57-27d2347ba07d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"
Oct 30 22:30:00.687509 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.687475    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wfj2\" (UniqueName: \"kubernetes.io/projected/0685291a-5d96-43e4-86e8-70fe359214b4-kube-api-access-8wfj2\") pod \"maas-api-revoke-keys-e2e-api-a-56c628-846jh\" (UID: \"0685291a-5d96-43e4-86e8-70fe359214b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"
Oct 30 22:30:00.703688 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.703650    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" containerID="cri-o://990e1ead2ab39eca18d8719229ce5b1365d7e5dd83f9ab3243f691f38180a3be" gracePeriod=45
Oct 30 22:30:00.836852 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.836787    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": dial tcp 10.132.0.74:8000: connect: connection refused"
Oct 30 22:30:00.977080 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.976877    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"
Oct 30 22:30:00.977080 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.977028    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"
Oct 30 22:30:00.989454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:00.989307    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:30:01.011237 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:30:01.011207    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05348d0_23b5_49d1_8171_17f2ccbcd41a.slice/crio-8a8b0224f4f17673e90b8dd77e430a91628d8566a8150fc58c304e825df40d56 WatchSource:0}: Error finding container 8a8b0224f4f17673e90b8dd77e430a91628d8566a8150fc58c304e825df40d56: Status 404 returned error can't find the container with id 8a8b0224f4f17673e90b8dd77e430a91628d8566a8150fc58c304e825df40d56
Oct 30 22:30:01.013309 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.013288    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"]
Oct 30 22:30:01.020643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.019558    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:30:01.121432 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.121343    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-dshm\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-dshm\") pod \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") "
Oct 30 22:30:01.121733 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.121708    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef98472f-83c5-490b-b4ea-57077ea8c8d4-kube-api-access-djdgz\" (UniqueName: \"kubernetes.io/projected/ef98472f-83c5-490b-b4ea-57077ea8c8d4-kube-api-access-djdgz\") pod \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") "
Oct 30 22:30:01.121976 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.121954    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/959a5d75-a7e2-4767-873d-6cd573c1bbd7-tls-certs\" (UniqueName: \"kubernetes.io/secret/959a5d75-a7e2-4767-873d-6cd573c1bbd7-tls-certs\") pod \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") "
Oct 30 22:30:01.122142 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.122124    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/959a5d75-a7e2-4767-873d-6cd573c1bbd7-kube-api-access-pqwfx\" (UniqueName: \"kubernetes.io/projected/959a5d75-a7e2-4767-873d-6cd573c1bbd7-kube-api-access-pqwfx\") pod \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") "
Oct 30 22:30:01.122305 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.122287    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-model-cache\") pod \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") "
Oct 30 22:30:01.122442 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.122426    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-dshm\") pod \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") "
Oct 30 22:30:01.122571 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.122556    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-home\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-home\") pod \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") "
Oct 30 22:30:01.123612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.122769    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-model-cache" pod "ef98472f-83c5-490b-b4ea-57077ea8c8d4" (UID: "ef98472f-83c5-490b-b4ea-57077ea8c8d4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:01.123612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.122819    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-model-cache\") pod \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") "
Oct 30 22:30:01.123612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.123034    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-model-cache" pod "959a5d75-a7e2-4767-873d-6cd573c1bbd7" (UID: "959a5d75-a7e2-4767-873d-6cd573c1bbd7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:01.123612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.123041    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-tmp-dir\") pod \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") "
Oct 30 22:30:01.123612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.123123    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-tmp-dir\") pod \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") "
Oct 30 22:30:01.123612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.123169    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-home\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-home\") pod \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\" (UID: \"959a5d75-a7e2-4767-873d-6cd573c1bbd7\") "
Oct 30 22:30:01.123612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.123215    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef98472f-83c5-490b-b4ea-57077ea8c8d4-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef98472f-83c5-490b-b4ea-57077ea8c8d4-tls-certs\") pod \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\" (UID: \"ef98472f-83c5-490b-b4ea-57077ea8c8d4\") "
Oct 30 22:30:01.124389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.123217    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-home" pod "ef98472f-83c5-490b-b4ea-57077ea8c8d4" (UID: "ef98472f-83c5-490b-b4ea-57077ea8c8d4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:01.124389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.123332    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-tmp-dir" pod "ef98472f-83c5-490b-b4ea-57077ea8c8d4" (UID: "ef98472f-83c5-490b-b4ea-57077ea8c8d4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:01.124389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.123511    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-home" pod "959a5d75-a7e2-4767-873d-6cd573c1bbd7" (UID: "959a5d75-a7e2-4767-873d-6cd573c1bbd7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:01.124389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.123696    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-tmp-dir" pod "959a5d75-a7e2-4767-873d-6cd573c1bbd7" (UID: "959a5d75-a7e2-4767-873d-6cd573c1bbd7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:01.124389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.124214    5258 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-model-cache\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:01.124389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.124235    5258 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-tmp-dir\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:01.124389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.124249    5258 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-tmp-dir\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:01.124389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.124260    5258 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-home\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:01.124389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.124273    5258 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-model-cache\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:01.124389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.124284    5258 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-home\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:01.127787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.127539    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/959a5d75-a7e2-4767-873d-6cd573c1bbd7-kube-api-access-pqwfx" pod "959a5d75-a7e2-4767-873d-6cd573c1bbd7" (UID: "959a5d75-a7e2-4767-873d-6cd573c1bbd7"). InnerVolumeSpecName "kube-api-access-pqwfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:01.127787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.127740    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-dshm" pod "959a5d75-a7e2-4767-873d-6cd573c1bbd7" (UID: "959a5d75-a7e2-4767-873d-6cd573c1bbd7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:01.128115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.127829    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef98472f-83c5-490b-b4ea-57077ea8c8d4-kube-api-access-djdgz" pod "ef98472f-83c5-490b-b4ea-57077ea8c8d4" (UID: "ef98472f-83c5-490b-b4ea-57077ea8c8d4"). InnerVolumeSpecName "kube-api-access-djdgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:01.128469 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.128436    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef98472f-83c5-490b-b4ea-57077ea8c8d4-tls-certs" pod "ef98472f-83c5-490b-b4ea-57077ea8c8d4" (UID: "ef98472f-83c5-490b-b4ea-57077ea8c8d4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:30:01.129511 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.129476    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/959a5d75-a7e2-4767-873d-6cd573c1bbd7-tls-certs" pod "959a5d75-a7e2-4767-873d-6cd573c1bbd7" (UID: "959a5d75-a7e2-4767-873d-6cd573c1bbd7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:30:01.130532 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.130495    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-dshm" pod "ef98472f-83c5-490b-b4ea-57077ea8c8d4" (UID: "ef98472f-83c5-490b-b4ea-57077ea8c8d4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:30:01.226455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.226416    5258 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/959a5d75-a7e2-4767-873d-6cd573c1bbd7-dshm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:01.226455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.226458    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djdgz\" (UniqueName: \"kubernetes.io/projected/ef98472f-83c5-490b-b4ea-57077ea8c8d4-kube-api-access-djdgz\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:01.226712 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.226474    5258 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/959a5d75-a7e2-4767-873d-6cd573c1bbd7-tls-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:01.226712 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.226489    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqwfx\" (UniqueName: \"kubernetes.io/projected/959a5d75-a7e2-4767-873d-6cd573c1bbd7-kube-api-access-pqwfx\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:01.226712 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.226502    5258 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef98472f-83c5-490b-b4ea-57077ea8c8d4-dshm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:01.226712 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.226515    5258 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef98472f-83c5-490b-b4ea-57077ea8c8d4-tls-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:01.394881 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.394854    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"]
Oct 30 22:30:01.395333 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:30:01.395314    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0685291a_5d96_43e4_86e8_70fe359214b4.slice/crio-1ef0e9600341589cf0d465f6794c63cedaaa184fde183d14040a806013c56131 WatchSource:0}: Error finding container 1ef0e9600341589cf0d465f6794c63cedaaa184fde183d14040a806013c56131: Status 404 returned error can't find the container with id 1ef0e9600341589cf0d465f6794c63cedaaa184fde183d14040a806013c56131
Oct 30 22:30:01.448381 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.448352    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"]
Oct 30 22:30:01.449444 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:30:01.449419    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod769ff87d_8eca_48b8_ae57_27d2347ba07d.slice/crio-5ed6a0a5bfb7802de830b68e303b76528bad31dd5a1ef5e57aeadc6eb43a53f2 WatchSource:0}: Error finding container 5ed6a0a5bfb7802de830b68e303b76528bad31dd5a1ef5e57aeadc6eb43a53f2: Status 404 returned error can't find the container with id 5ed6a0a5bfb7802de830b68e303b76528bad31dd5a1ef5e57aeadc6eb43a53f2
Oct 30 22:30:01.561623 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.561564    5258 generic.go:356] "Generic (PLEG): container finished" podID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerID="e08b8e0434caeeea9ae1ba7369cf0dbc5ac5aaa8ea8ef35e16e1e5484a455991" exitCode=0
Oct 30 22:30:01.561755 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.561644    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"
Oct 30 22:30:01.561755 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.561643    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" event={"ID":"ef98472f-83c5-490b-b4ea-57077ea8c8d4","Type":"ContainerDied","Data":"e08b8e0434caeeea9ae1ba7369cf0dbc5ac5aaa8ea8ef35e16e1e5484a455991"}
Oct 30 22:30:01.561755 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.561691    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9" event={"ID":"ef98472f-83c5-490b-b4ea-57077ea8c8d4","Type":"ContainerDied","Data":"9e2c080983f93aedbe4c1c028479d401686706b1d210d61095f235553dd32141"}
Oct 30 22:30:01.561755 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.561714    5258 scope.go:122] "RemoveContainer" containerID="e08b8e0434caeeea9ae1ba7369cf0dbc5ac5aaa8ea8ef35e16e1e5484a455991"
Oct 30 22:30:01.563290 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.563263    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf" event={"ID":"769ff87d-8eca-48b8-ae57-27d2347ba07d","Type":"ContainerStarted","Data":"5ed6a0a5bfb7802de830b68e303b76528bad31dd5a1ef5e57aeadc6eb43a53f2"}
Oct 30 22:30:01.564880 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.564859    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh" event={"ID":"0685291a-5d96-43e4-86e8-70fe359214b4","Type":"ContainerStarted","Data":"1ef0e9600341589cf0d465f6794c63cedaaa184fde183d14040a806013c56131"}
Oct 30 22:30:01.566249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.566229    5258 generic.go:356] "Generic (PLEG): container finished" podID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerID="990e1ead2ab39eca18d8719229ce5b1365d7e5dd83f9ab3243f691f38180a3be" exitCode=0
Oct 30 22:30:01.566348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.566270    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"
Oct 30 22:30:01.566348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.566310    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" event={"ID":"959a5d75-a7e2-4767-873d-6cd573c1bbd7","Type":"ContainerDied","Data":"990e1ead2ab39eca18d8719229ce5b1365d7e5dd83f9ab3243f691f38180a3be"}
Oct 30 22:30:01.566348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.566341    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7" event={"ID":"959a5d75-a7e2-4767-873d-6cd573c1bbd7","Type":"ContainerDied","Data":"f8f81f6ffa11218547efd29ec449ab138a7d901dad0fd3436ca73fb545975c9a"}
Oct 30 22:30:01.568007 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.567986    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf" event={"ID":"e05348d0-23b5-49d1-8171-17f2ccbcd41a","Type":"ContainerStarted","Data":"96cd4bd5b9fb2ed9e94e82f4298a0ccb9a1dd92fb0fa7e318b2c1adcb5d177b5"}
Oct 30 22:30:01.568093 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.568022    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf" event={"ID":"e05348d0-23b5-49d1-8171-17f2ccbcd41a","Type":"ContainerStarted","Data":"8a8b0224f4f17673e90b8dd77e430a91628d8566a8150fc58c304e825df40d56"}
Oct 30 22:30:01.621032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.620852    5258 scope.go:122] "RemoveContainer" containerID="e08b8e0434caeeea9ae1ba7369cf0dbc5ac5aaa8ea8ef35e16e1e5484a455991"
Oct 30 22:30:01.621225 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:30:01.621206    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e08b8e0434caeeea9ae1ba7369cf0dbc5ac5aaa8ea8ef35e16e1e5484a455991\": container with ID starting with e08b8e0434caeeea9ae1ba7369cf0dbc5ac5aaa8ea8ef35e16e1e5484a455991 not found: ID does not exist" containerID="e08b8e0434caeeea9ae1ba7369cf0dbc5ac5aaa8ea8ef35e16e1e5484a455991"
Oct 30 22:30:01.621272 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.621233    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e08b8e0434caeeea9ae1ba7369cf0dbc5ac5aaa8ea8ef35e16e1e5484a455991"} err="failed to get container status \"e08b8e0434caeeea9ae1ba7369cf0dbc5ac5aaa8ea8ef35e16e1e5484a455991\": rpc error: code = NotFound desc = could not find container \"e08b8e0434caeeea9ae1ba7369cf0dbc5ac5aaa8ea8ef35e16e1e5484a455991\": container with ID starting with e08b8e0434caeeea9ae1ba7369cf0dbc5ac5aaa8ea8ef35e16e1e5484a455991 not found: ID does not exist"
Oct 30 22:30:01.621272 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.621248    5258 scope.go:122] "RemoveContainer" containerID="990e1ead2ab39eca18d8719229ce5b1365d7e5dd83f9ab3243f691f38180a3be"
Oct 30 22:30:01.631533 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.631511    5258 scope.go:122] "RemoveContainer" containerID="990e1ead2ab39eca18d8719229ce5b1365d7e5dd83f9ab3243f691f38180a3be"
Oct 30 22:30:01.631848 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:30:01.631821    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"990e1ead2ab39eca18d8719229ce5b1365d7e5dd83f9ab3243f691f38180a3be\": container with ID starting with 990e1ead2ab39eca18d8719229ce5b1365d7e5dd83f9ab3243f691f38180a3be not found: ID does not exist" containerID="990e1ead2ab39eca18d8719229ce5b1365d7e5dd83f9ab3243f691f38180a3be"
Oct 30 22:30:01.631924 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.631858    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"990e1ead2ab39eca18d8719229ce5b1365d7e5dd83f9ab3243f691f38180a3be"} err="failed to get container status \"990e1ead2ab39eca18d8719229ce5b1365d7e5dd83f9ab3243f691f38180a3be\": rpc error: code = NotFound desc = could not find container \"990e1ead2ab39eca18d8719229ce5b1365d7e5dd83f9ab3243f691f38180a3be\": container with ID starting with 990e1ead2ab39eca18d8719229ce5b1365d7e5dd83f9ab3243f691f38180a3be not found: ID does not exist"
Oct 30 22:30:01.732567 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.732517    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf" podStartSLOduration=1.732503714 podStartE2EDuration="1.732503714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:30:01.731989708 +0000 UTC m=+2116.462846851" watchObservedRunningTime="2026-10-30 22:30:01.732503714 +0000 UTC m=+2116.463360857"
Oct 30 22:30:01.899584 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.899552    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"]
Oct 30 22:30:01.903145 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:01.903119    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-963c3a/simulator-w3-963c3a-kserve-7f4b4f6d9-mrcv7"]
Oct 30 22:30:02.014603 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:02.014550    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"]
Oct 30 22:30:02.019812 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:02.019782    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-963c3a/distinct-2-w3-963c3a-kserve-6657776596-n45z9"]
Oct 30 22:30:02.578025 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:02.577997    5258 generic.go:356] "Generic (PLEG): container finished" podID="0685291a-5d96-43e4-86e8-70fe359214b4" containerID="6fdfe32f1c49a118c26a05b8191c0bbe92d0e03be91d20c58cc03c3a0e70ac8e" exitCode=0
Oct 30 22:30:02.578436 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:02.578119    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh" event={"ID":"0685291a-5d96-43e4-86e8-70fe359214b4","Type":"ContainerDied","Data":"6fdfe32f1c49a118c26a05b8191c0bbe92d0e03be91d20c58cc03c3a0e70ac8e"}
Oct 30 22:30:02.580811 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:02.580787    5258 generic.go:356] "Generic (PLEG): container finished" podID="e05348d0-23b5-49d1-8171-17f2ccbcd41a" containerID="96cd4bd5b9fb2ed9e94e82f4298a0ccb9a1dd92fb0fa7e318b2c1adcb5d177b5" exitCode=60
Oct 30 22:30:02.580901 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:02.580858    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf" event={"ID":"e05348d0-23b5-49d1-8171-17f2ccbcd41a","Type":"ContainerDied","Data":"96cd4bd5b9fb2ed9e94e82f4298a0ccb9a1dd92fb0fa7e318b2c1adcb5d177b5"}
Oct 30 22:30:02.581219 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:02.581197    5258 scope.go:122] "RemoveContainer" containerID="96cd4bd5b9fb2ed9e94e82f4298a0ccb9a1dd92fb0fa7e318b2c1adcb5d177b5"
Oct 30 22:30:02.597447 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:02.597416    5258 generic.go:356] "Generic (PLEG): container finished" podID="769ff87d-8eca-48b8-ae57-27d2347ba07d" containerID="e8a921ae2c3ff518f8803879086a460f0004307116269aa2aabefd95d6b53b54" exitCode=60
Oct 30 22:30:02.597579 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:02.597526    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf" event={"ID":"769ff87d-8eca-48b8-ae57-27d2347ba07d","Type":"ContainerDied","Data":"e8a921ae2c3ff518f8803879086a460f0004307116269aa2aabefd95d6b53b54"}
Oct 30 22:30:02.598113 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:02.598081    5258 scope.go:122] "RemoveContainer" containerID="e8a921ae2c3ff518f8803879086a460f0004307116269aa2aabefd95d6b53b54"
Oct 30 22:30:03.205077 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.205040    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:03.382906 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.382871    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" path="/var/lib/kubelet/pods/959a5d75-a7e2-4767-873d-6cd573c1bbd7/volumes"
Oct 30 22:30:03.383363 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.383348    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" path="/var/lib/kubelet/pods/ef98472f-83c5-490b-b4ea-57077ea8c8d4/volumes"
Oct 30 22:30:03.608222 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.608191    5258 generic.go:356] "Generic (PLEG): container finished" podID="769ff87d-8eca-48b8-ae57-27d2347ba07d" containerID="46808f99235d463bc43e9c59957e6c6edaedbb40d0ef8f4db4290d7f6b9b497b" exitCode=60
Oct 30 22:30:03.608643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.608274    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf" event={"ID":"769ff87d-8eca-48b8-ae57-27d2347ba07d","Type":"ContainerDied","Data":"46808f99235d463bc43e9c59957e6c6edaedbb40d0ef8f4db4290d7f6b9b497b"}
Oct 30 22:30:03.608643 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.608341    5258 scope.go:122] "RemoveContainer" containerID="e8a921ae2c3ff518f8803879086a460f0004307116269aa2aabefd95d6b53b54"
Oct 30 22:30:03.608765 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.608748    5258 scope.go:122] "RemoveContainer" containerID="46808f99235d463bc43e9c59957e6c6edaedbb40d0ef8f4db4290d7f6b9b497b"
Oct 30 22:30:03.609125 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:30:03.609101    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf_odh-ai-gateway-infra(769ff87d-8eca-48b8-ae57-27d2347ba07d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf" podUID="769ff87d-8eca-48b8-ae57-27d2347ba07d"
Oct 30 22:30:03.610652 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.610625    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf" event={"ID":"e05348d0-23b5-49d1-8171-17f2ccbcd41a","Type":"ContainerStarted","Data":"280ca9051edd1d9878de5af6abb616de87c6ade1f1501d78b7ab43db6cc0fabd"}
Oct 30 22:30:03.799674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.799650    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"
Oct 30 22:30:03.869929 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.869857    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0685291a-5d96-43e4-86e8-70fe359214b4-kube-api-access-8wfj2\" (UniqueName: \"kubernetes.io/projected/0685291a-5d96-43e4-86e8-70fe359214b4-kube-api-access-8wfj2\") pod \"0685291a-5d96-43e4-86e8-70fe359214b4\" (UID: \"0685291a-5d96-43e4-86e8-70fe359214b4\") "
Oct 30 22:30:03.870084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.870053    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0685291a-5d96-43e4-86e8-70fe359214b4-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0685291a-5d96-43e4-86e8-70fe359214b4-maas-api-xks-ca\") pod \"0685291a-5d96-43e4-86e8-70fe359214b4\" (UID: \"0685291a-5d96-43e4-86e8-70fe359214b4\") "
Oct 30 22:30:03.870232 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.870214    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0685291a-5d96-43e4-86e8-70fe359214b4-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0685291a-5d96-43e4-86e8-70fe359214b4-maas-api-openshift-ca\") pod \"0685291a-5d96-43e4-86e8-70fe359214b4\" (UID: \"0685291a-5d96-43e4-86e8-70fe359214b4\") "
Oct 30 22:30:03.870662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.870635    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0685291a-5d96-43e4-86e8-70fe359214b4-maas-api-openshift-ca" pod "0685291a-5d96-43e4-86e8-70fe359214b4" (UID: "0685291a-5d96-43e4-86e8-70fe359214b4"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:03.870819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.870793    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0685291a-5d96-43e4-86e8-70fe359214b4-maas-api-openshift-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:03.872337 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.872308    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0685291a-5d96-43e4-86e8-70fe359214b4-maas-api-xks-ca" pod "0685291a-5d96-43e4-86e8-70fe359214b4" (UID: "0685291a-5d96-43e4-86e8-70fe359214b4"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:30:03.872566 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.872546    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0685291a-5d96-43e4-86e8-70fe359214b4-kube-api-access-8wfj2" pod "0685291a-5d96-43e4-86e8-70fe359214b4" (UID: "0685291a-5d96-43e4-86e8-70fe359214b4"). InnerVolumeSpecName "kube-api-access-8wfj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:03.972528 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.972484    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wfj2\" (UniqueName: \"kubernetes.io/projected/0685291a-5d96-43e4-86e8-70fe359214b4-kube-api-access-8wfj2\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:03.972528 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:03.972525    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0685291a-5d96-43e4-86e8-70fe359214b4-maas-api-xks-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:04.620022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:04.619989    5258 scope.go:122] "RemoveContainer" containerID="46808f99235d463bc43e9c59957e6c6edaedbb40d0ef8f4db4290d7f6b9b497b"
Oct 30 22:30:04.620473 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:30:04.620298    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf_odh-ai-gateway-infra(769ff87d-8eca-48b8-ae57-27d2347ba07d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf" podUID="769ff87d-8eca-48b8-ae57-27d2347ba07d"
Oct 30 22:30:04.621185 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:04.621162    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"
Oct 30 22:30:04.621288 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:04.621201    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh" event={"ID":"0685291a-5d96-43e4-86e8-70fe359214b4","Type":"ContainerDied","Data":"1ef0e9600341589cf0d465f6794c63cedaaa184fde183d14040a806013c56131"}
Oct 30 22:30:04.621288 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:04.621253    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ef0e9600341589cf0d465f6794c63cedaaa184fde183d14040a806013c56131"
Oct 30 22:30:04.623372 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:04.623350    5258 generic.go:356] "Generic (PLEG): container finished" podID="e05348d0-23b5-49d1-8171-17f2ccbcd41a" containerID="280ca9051edd1d9878de5af6abb616de87c6ade1f1501d78b7ab43db6cc0fabd" exitCode=60
Oct 30 22:30:04.623489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:04.623430    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf" event={"ID":"e05348d0-23b5-49d1-8171-17f2ccbcd41a","Type":"ContainerDied","Data":"280ca9051edd1d9878de5af6abb616de87c6ade1f1501d78b7ab43db6cc0fabd"}
Oct 30 22:30:04.623489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:04.623483    5258 scope.go:122] "RemoveContainer" containerID="96cd4bd5b9fb2ed9e94e82f4298a0ccb9a1dd92fb0fa7e318b2c1adcb5d177b5"
Oct 30 22:30:04.623693 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:04.623671    5258 scope.go:122] "RemoveContainer" containerID="280ca9051edd1d9878de5af6abb616de87c6ade1f1501d78b7ab43db6cc0fabd"
Oct 30 22:30:04.623976 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:30:04.623951    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf_odh-ai-gateway-infra(e05348d0-23b5-49d1-8171-17f2ccbcd41a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf" podUID="e05348d0-23b5-49d1-8171-17f2ccbcd41a"
Oct 30 22:30:05.354787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.354753    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"]
Oct 30 22:30:05.355425 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.355412    5258 cpu_manager.go:414] "containerMap: removing container" podUID="0685291a-5d96-43e4-86e8-70fe359214b4" containerName="revoke-keys"
Oct 30 22:30:05.355474 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.355427    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0685291a-5d96-43e4-86e8-70fe359214b4" containerName="revoke-keys"
Oct 30 22:30:05.355474 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.355439    5258 cpu_manager.go:414] "containerMap: removing container" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main"
Oct 30 22:30:05.355474 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.355444    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main"
Oct 30 22:30:05.355474 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.355451    5258 cpu_manager.go:414] "containerMap: removing container" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main"
Oct 30 22:30:05.355474 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.355456    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main"
Oct 30 22:30:05.355674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.355606    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="0685291a-5d96-43e4-86e8-70fe359214b4" containerName="revoke-keys"
Oct 30 22:30:05.355674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.355614    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="959a5d75-a7e2-4767-873d-6cd573c1bbd7" containerName="main"
Oct 30 22:30:05.355674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.355619    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef98472f-83c5-490b-b4ea-57077ea8c8d4" containerName="main"
Oct 30 22:30:05.360357 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.360339    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"
Oct 30 22:30:05.388641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.388616    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f6d7\" (UniqueName: \"kubernetes.io/projected/1e96c175-4b69-4475-9ed9-593a932b5eca-kube-api-access-9f6d7\") pod \"maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv\" (UID: \"1e96c175-4b69-4475-9ed9-593a932b5eca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"
Oct 30 22:30:05.388758 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.388652    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1e96c175-4b69-4475-9ed9-593a932b5eca-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv\" (UID: \"1e96c175-4b69-4475-9ed9-593a932b5eca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"
Oct 30 22:30:05.388799 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.388775    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1e96c175-4b69-4475-9ed9-593a932b5eca-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv\" (UID: \"1e96c175-4b69-4475-9ed9-593a932b5eca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"
Oct 30 22:30:05.414535 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.414510    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:30:05.418821 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.418794    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"]
Oct 30 22:30:05.490530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.490490    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1e96c175-4b69-4475-9ed9-593a932b5eca-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv\" (UID: \"1e96c175-4b69-4475-9ed9-593a932b5eca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"
Oct 30 22:30:05.490801 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.490779    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f6d7\" (UniqueName: \"kubernetes.io/projected/1e96c175-4b69-4475-9ed9-593a932b5eca-kube-api-access-9f6d7\") pod \"maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv\" (UID: \"1e96c175-4b69-4475-9ed9-593a932b5eca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"
Oct 30 22:30:05.490894 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.490820    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1e96c175-4b69-4475-9ed9-593a932b5eca-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv\" (UID: \"1e96c175-4b69-4475-9ed9-593a932b5eca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"
Oct 30 22:30:05.491717 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.491687    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1e96c175-4b69-4475-9ed9-593a932b5eca-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv\" (UID: \"1e96c175-4b69-4475-9ed9-593a932b5eca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"
Oct 30 22:30:05.493081 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.493057    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1e96c175-4b69-4475-9ed9-593a932b5eca-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv\" (UID: \"1e96c175-4b69-4475-9ed9-593a932b5eca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"
Oct 30 22:30:05.553420 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.553381    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f6d7\" (UniqueName: \"kubernetes.io/projected/1e96c175-4b69-4475-9ed9-593a932b5eca-kube-api-access-9f6d7\") pod \"maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv\" (UID: \"1e96c175-4b69-4475-9ed9-593a932b5eca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"
Oct 30 22:30:05.634610 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.634510    5258 scope.go:122] "RemoveContainer" containerID="280ca9051edd1d9878de5af6abb616de87c6ade1f1501d78b7ab43db6cc0fabd"
Oct 30 22:30:05.635024 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:30:05.634920    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf_odh-ai-gateway-infra(e05348d0-23b5-49d1-8171-17f2ccbcd41a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf" podUID="e05348d0-23b5-49d1-8171-17f2ccbcd41a"
Oct 30 22:30:05.674263 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:05.674233    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"
Oct 30 22:30:06.060813 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:06.060776    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"]
Oct 30 22:30:06.061378 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:30:06.060972    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e96c175_4b69_4475_9ed9_593a932b5eca.slice/crio-d7daae4a91e2e30d1859c021133ed0d13a52fdc53840954cfdb03511d7f2fa6b WatchSource:0}: Error finding container d7daae4a91e2e30d1859c021133ed0d13a52fdc53840954cfdb03511d7f2fa6b: Status 404 returned error can't find the container with id d7daae4a91e2e30d1859c021133ed0d13a52fdc53840954cfdb03511d7f2fa6b
Oct 30 22:30:06.643532 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:06.643423    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv" event={"ID":"1e96c175-4b69-4475-9ed9-593a932b5eca","Type":"ContainerStarted","Data":"f04d2ed3445a647267e66f4e7c21c1bf0c8ed56dec4e1bda849ff759699e1f86"}
Oct 30 22:30:06.643532 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:06.643479    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv" event={"ID":"1e96c175-4b69-4475-9ed9-593a932b5eca","Type":"ContainerStarted","Data":"d7daae4a91e2e30d1859c021133ed0d13a52fdc53840954cfdb03511d7f2fa6b"}
Oct 30 22:30:06.764348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:06.764295    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv" podStartSLOduration=1.764275861 podStartE2EDuration="1.764275861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:30:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:30:06.761578053 +0000 UTC m=+2121.492435204" watchObservedRunningTime="2026-10-30 22:30:06.764275861 +0000 UTC m=+2121.495133021"
Oct 30 22:30:07.653036 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:07.653002    5258 generic.go:356] "Generic (PLEG): container finished" podID="1e96c175-4b69-4475-9ed9-593a932b5eca" containerID="f04d2ed3445a647267e66f4e7c21c1bf0c8ed56dec4e1bda849ff759699e1f86" exitCode=0
Oct 30 22:30:07.653445 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:07.653088    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv" event={"ID":"1e96c175-4b69-4475-9ed9-593a932b5eca","Type":"ContainerDied","Data":"f04d2ed3445a647267e66f4e7c21c1bf0c8ed56dec4e1bda849ff759699e1f86"}
Oct 30 22:30:08.851220 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:08.851194    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"
Oct 30 22:30:08.933707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:08.933628    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e96c175-4b69-4475-9ed9-593a932b5eca-kube-api-access-9f6d7\" (UniqueName: \"kubernetes.io/projected/1e96c175-4b69-4475-9ed9-593a932b5eca-kube-api-access-9f6d7\") pod \"1e96c175-4b69-4475-9ed9-593a932b5eca\" (UID: \"1e96c175-4b69-4475-9ed9-593a932b5eca\") "
Oct 30 22:30:08.933840 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:08.933737    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1e96c175-4b69-4475-9ed9-593a932b5eca-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1e96c175-4b69-4475-9ed9-593a932b5eca-maas-api-xks-ca\") pod \"1e96c175-4b69-4475-9ed9-593a932b5eca\" (UID: \"1e96c175-4b69-4475-9ed9-593a932b5eca\") "
Oct 30 22:30:08.933929 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:08.933913    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e96c175-4b69-4475-9ed9-593a932b5eca-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1e96c175-4b69-4475-9ed9-593a932b5eca-maas-api-openshift-ca\") pod \"1e96c175-4b69-4475-9ed9-593a932b5eca\" (UID: \"1e96c175-4b69-4475-9ed9-593a932b5eca\") "
Oct 30 22:30:08.934353 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:08.934312    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e96c175-4b69-4475-9ed9-593a932b5eca-maas-api-openshift-ca" pod "1e96c175-4b69-4475-9ed9-593a932b5eca" (UID: "1e96c175-4b69-4475-9ed9-593a932b5eca"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:08.935774 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:08.935747    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e96c175-4b69-4475-9ed9-593a932b5eca-maas-api-xks-ca" pod "1e96c175-4b69-4475-9ed9-593a932b5eca" (UID: "1e96c175-4b69-4475-9ed9-593a932b5eca"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:30:08.935890 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:08.935866    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e96c175-4b69-4475-9ed9-593a932b5eca-kube-api-access-9f6d7" pod "1e96c175-4b69-4475-9ed9-593a932b5eca" (UID: "1e96c175-4b69-4475-9ed9-593a932b5eca"). InnerVolumeSpecName "kube-api-access-9f6d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:09.011117 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:09.011084    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:09.036027 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:09.035998    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1e96c175-4b69-4475-9ed9-593a932b5eca-maas-api-openshift-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:09.036027 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:09.036024    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f6d7\" (UniqueName: \"kubernetes.io/projected/1e96c175-4b69-4475-9ed9-593a932b5eca-kube-api-access-9f6d7\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:09.036183 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:09.036037    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1e96c175-4b69-4475-9ed9-593a932b5eca-maas-api-xks-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:09.670351 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:09.670265    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"
Oct 30 22:30:09.670351 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:09.670301    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv" event={"ID":"1e96c175-4b69-4475-9ed9-593a932b5eca","Type":"ContainerDied","Data":"d7daae4a91e2e30d1859c021133ed0d13a52fdc53840954cfdb03511d7f2fa6b"}
Oct 30 22:30:09.670576 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:09.670352    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7daae4a91e2e30d1859c021133ed0d13a52fdc53840954cfdb03511d7f2fa6b"
Oct 30 22:30:10.401906 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.401867    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"]
Oct 30 22:30:10.402857 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.402831    5258 cpu_manager.go:414] "containerMap: removing container" podUID="1e96c175-4b69-4475-9ed9-593a932b5eca" containerName="revoke-keys"
Oct 30 22:30:10.402857 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.402854    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e96c175-4b69-4475-9ed9-593a932b5eca" containerName="revoke-keys"
Oct 30 22:30:10.403020 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.402999    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e96c175-4b69-4475-9ed9-593a932b5eca" containerName="revoke-keys"
Oct 30 22:30:10.406844 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.406820    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"
Oct 30 22:30:10.454402 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.454367    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/74842bd9-f833-4cc2-b4e9-139741fac7ff-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws\" (UID: \"74842bd9-f833-4cc2-b4e9-139741fac7ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"
Oct 30 22:30:10.454550 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.454526    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/74842bd9-f833-4cc2-b4e9-139741fac7ff-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws\" (UID: \"74842bd9-f833-4cc2-b4e9-139741fac7ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"
Oct 30 22:30:10.454698 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.454676    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhj6v\" (UniqueName: \"kubernetes.io/projected/74842bd9-f833-4cc2-b4e9-139741fac7ff-kube-api-access-zhj6v\") pod \"maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws\" (UID: \"74842bd9-f833-4cc2-b4e9-139741fac7ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"
Oct 30 22:30:10.465964 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.465937    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"]
Oct 30 22:30:10.510043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.510009    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:30:10.555674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.555640    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/74842bd9-f833-4cc2-b4e9-139741fac7ff-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws\" (UID: \"74842bd9-f833-4cc2-b4e9-139741fac7ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"
Oct 30 22:30:10.555790 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.555772    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhj6v\" (UniqueName: \"kubernetes.io/projected/74842bd9-f833-4cc2-b4e9-139741fac7ff-kube-api-access-zhj6v\") pod \"maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws\" (UID: \"74842bd9-f833-4cc2-b4e9-139741fac7ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"
Oct 30 22:30:10.555937 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.555918    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/74842bd9-f833-4cc2-b4e9-139741fac7ff-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws\" (UID: \"74842bd9-f833-4cc2-b4e9-139741fac7ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"
Oct 30 22:30:10.556431 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.556361    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/74842bd9-f833-4cc2-b4e9-139741fac7ff-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws\" (UID: \"74842bd9-f833-4cc2-b4e9-139741fac7ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"
Oct 30 22:30:10.558556 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.558532    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/74842bd9-f833-4cc2-b4e9-139741fac7ff-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws\" (UID: \"74842bd9-f833-4cc2-b4e9-139741fac7ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"
Oct 30 22:30:10.617877 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.617849    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhj6v\" (UniqueName: \"kubernetes.io/projected/74842bd9-f833-4cc2-b4e9-139741fac7ff-kube-api-access-zhj6v\") pod \"maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws\" (UID: \"74842bd9-f833-4cc2-b4e9-139741fac7ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"
Oct 30 22:30:10.720249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:10.720178    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"
Oct 30 22:30:11.113433 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:11.113408    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"]
Oct 30 22:30:11.113572 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:30:11.113520    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74842bd9_f833_4cc2_b4e9_139741fac7ff.slice/crio-72a2cedbdaaefda30333e6999bb62f141b316e477db5bb147c9387bd740e20f1 WatchSource:0}: Error finding container 72a2cedbdaaefda30333e6999bb62f141b316e477db5bb147c9387bd740e20f1: Status 404 returned error can't find the container with id 72a2cedbdaaefda30333e6999bb62f141b316e477db5bb147c9387bd740e20f1
Oct 30 22:30:11.689322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:11.689234    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws" event={"ID":"74842bd9-f833-4cc2-b4e9-139741fac7ff","Type":"ContainerStarted","Data":"0ab6870c5313d540c1121e05998c99e2a70feed10e32ed95c0de005f52f4a6ac"}
Oct 30 22:30:11.689322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:11.689287    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws" event={"ID":"74842bd9-f833-4cc2-b4e9-139741fac7ff","Type":"ContainerStarted","Data":"72a2cedbdaaefda30333e6999bb62f141b316e477db5bb147c9387bd740e20f1"}
Oct 30 22:30:11.809886 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:11.809839    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws" podStartSLOduration=1.809825661 podStartE2EDuration="1.809825661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:30:11.806800676 +0000 UTC m=+2126.537657821" watchObservedRunningTime="2026-10-30 22:30:11.809825661 +0000 UTC m=+2126.540682803"
Oct 30 22:30:11.979664 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:11.977246    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:12.256915 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:12.256834    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:12.700226 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:12.700193    5258 generic.go:356] "Generic (PLEG): container finished" podID="74842bd9-f833-4cc2-b4e9-139741fac7ff" containerID="0ab6870c5313d540c1121e05998c99e2a70feed10e32ed95c0de005f52f4a6ac" exitCode=0
Oct 30 22:30:12.700687 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:12.700281    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws" event={"ID":"74842bd9-f833-4cc2-b4e9-139741fac7ff","Type":"ContainerDied","Data":"0ab6870c5313d540c1121e05998c99e2a70feed10e32ed95c0de005f52f4a6ac"}
Oct 30 22:30:13.162167 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:30:13.162135    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:30:13.922772 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:13.922747    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"
Oct 30 22:30:14.042266 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:14.042171    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/74842bd9-f833-4cc2-b4e9-139741fac7ff-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/74842bd9-f833-4cc2-b4e9-139741fac7ff-maas-api-openshift-ca\") pod \"74842bd9-f833-4cc2-b4e9-139741fac7ff\" (UID: \"74842bd9-f833-4cc2-b4e9-139741fac7ff\") "
Oct 30 22:30:14.042523 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:14.042503    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/74842bd9-f833-4cc2-b4e9-139741fac7ff-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/74842bd9-f833-4cc2-b4e9-139741fac7ff-maas-api-xks-ca\") pod \"74842bd9-f833-4cc2-b4e9-139741fac7ff\" (UID: \"74842bd9-f833-4cc2-b4e9-139741fac7ff\") "
Oct 30 22:30:14.042911 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:14.042892    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74842bd9-f833-4cc2-b4e9-139741fac7ff-kube-api-access-zhj6v\" (UniqueName: \"kubernetes.io/projected/74842bd9-f833-4cc2-b4e9-139741fac7ff-kube-api-access-zhj6v\") pod \"74842bd9-f833-4cc2-b4e9-139741fac7ff\" (UID: \"74842bd9-f833-4cc2-b4e9-139741fac7ff\") "
Oct 30 22:30:14.043482 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:14.043456    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74842bd9-f833-4cc2-b4e9-139741fac7ff-maas-api-openshift-ca" pod "74842bd9-f833-4cc2-b4e9-139741fac7ff" (UID: "74842bd9-f833-4cc2-b4e9-139741fac7ff"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:14.043789 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:14.043766    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/74842bd9-f833-4cc2-b4e9-139741fac7ff-maas-api-openshift-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:14.073043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:14.073005    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74842bd9-f833-4cc2-b4e9-139741fac7ff-maas-api-xks-ca" pod "74842bd9-f833-4cc2-b4e9-139741fac7ff" (UID: "74842bd9-f833-4cc2-b4e9-139741fac7ff"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:30:14.073230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:14.073211    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74842bd9-f833-4cc2-b4e9-139741fac7ff-kube-api-access-zhj6v" pod "74842bd9-f833-4cc2-b4e9-139741fac7ff" (UID: "74842bd9-f833-4cc2-b4e9-139741fac7ff"). InnerVolumeSpecName "kube-api-access-zhj6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:14.144906 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:14.144872    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhj6v\" (UniqueName: \"kubernetes.io/projected/74842bd9-f833-4cc2-b4e9-139741fac7ff-kube-api-access-zhj6v\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:14.144906 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:14.144905    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/74842bd9-f833-4cc2-b4e9-139741fac7ff-maas-api-xks-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:14.297662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:14.297562    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:14.722018 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:14.721988    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"
Oct 30 22:30:14.722018 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:14.722007    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws" event={"ID":"74842bd9-f833-4cc2-b4e9-139741fac7ff","Type":"ContainerDied","Data":"72a2cedbdaaefda30333e6999bb62f141b316e477db5bb147c9387bd740e20f1"}
Oct 30 22:30:14.722333 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:14.722063    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72a2cedbdaaefda30333e6999bb62f141b316e477db5bb147c9387bd740e20f1"
Oct 30 22:30:17.329121 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:17.327907    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:17.373575 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:17.373528    5258 scope.go:122] "RemoveContainer" containerID="280ca9051edd1d9878de5af6abb616de87c6ade1f1501d78b7ab43db6cc0fabd"
Oct 30 22:30:17.373867 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:17.373844    5258 scope.go:122] "RemoveContainer" containerID="46808f99235d463bc43e9c59957e6c6edaedbb40d0ef8f4db4290d7f6b9b497b"
Oct 30 22:30:17.601416 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:17.601329    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:18.773237 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:18.773199    5258 generic.go:356] "Generic (PLEG): container finished" podID="e05348d0-23b5-49d1-8171-17f2ccbcd41a" containerID="decc411fc7889d91bdad2c5061241bfd5a704c54a8a6e1be88c164d33a4158a0" exitCode=60
Oct 30 22:30:18.774039 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:18.773994    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf" event={"ID":"e05348d0-23b5-49d1-8171-17f2ccbcd41a","Type":"ContainerDied","Data":"decc411fc7889d91bdad2c5061241bfd5a704c54a8a6e1be88c164d33a4158a0"}
Oct 30 22:30:18.774318 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:18.774291    5258 scope.go:122] "RemoveContainer" containerID="280ca9051edd1d9878de5af6abb616de87c6ade1f1501d78b7ab43db6cc0fabd"
Oct 30 22:30:18.775040 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:18.775017    5258 scope.go:122] "RemoveContainer" containerID="decc411fc7889d91bdad2c5061241bfd5a704c54a8a6e1be88c164d33a4158a0"
Oct 30 22:30:18.775422 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:30:18.775396    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf_odh-ai-gateway-infra(e05348d0-23b5-49d1-8171-17f2ccbcd41a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf" podUID="e05348d0-23b5-49d1-8171-17f2ccbcd41a"
Oct 30 22:30:18.779533 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:18.779505    5258 generic.go:356] "Generic (PLEG): container finished" podID="769ff87d-8eca-48b8-ae57-27d2347ba07d" containerID="8d7a2c444514685e33c60ecdcc61834f2e4129ab8ec9d1e2e18c7d369dbea02c" exitCode=60
Oct 30 22:30:18.779707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:18.779650    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf" event={"ID":"769ff87d-8eca-48b8-ae57-27d2347ba07d","Type":"ContainerDied","Data":"8d7a2c444514685e33c60ecdcc61834f2e4129ab8ec9d1e2e18c7d369dbea02c"}
Oct 30 22:30:18.780040 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:18.780022    5258 scope.go:122] "RemoveContainer" containerID="8d7a2c444514685e33c60ecdcc61834f2e4129ab8ec9d1e2e18c7d369dbea02c"
Oct 30 22:30:18.780340 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:30:18.780320    5258 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf_odh-ai-gateway-infra(769ff87d-8eca-48b8-ae57-27d2347ba07d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf" podUID="769ff87d-8eca-48b8-ae57-27d2347ba07d"
Oct 30 22:30:18.795140 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:18.795121    5258 scope.go:122] "RemoveContainer" containerID="46808f99235d463bc43e9c59957e6c6edaedbb40d0ef8f4db4290d7f6b9b497b"
Oct 30 22:30:19.914061 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:19.914022    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"]
Oct 30 22:30:20.038863 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.038822    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:20.043158 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.042821    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"]
Oct 30 22:30:20.157314 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.157273    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"
Oct 30 22:30:20.253346 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.253321    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"
Oct 30 22:30:20.273143 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.273117    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e05348d0-23b5-49d1-8171-17f2ccbcd41a-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e05348d0-23b5-49d1-8171-17f2ccbcd41a-maas-api-service-ca\") pod \"e05348d0-23b5-49d1-8171-17f2ccbcd41a\" (UID: \"e05348d0-23b5-49d1-8171-17f2ccbcd41a\") "
Oct 30 22:30:20.273292 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.273208    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e05348d0-23b5-49d1-8171-17f2ccbcd41a-kube-api-access-t4q4x\" (UniqueName: \"kubernetes.io/projected/e05348d0-23b5-49d1-8171-17f2ccbcd41a-kube-api-access-t4q4x\") pod \"e05348d0-23b5-49d1-8171-17f2ccbcd41a\" (UID: \"e05348d0-23b5-49d1-8171-17f2ccbcd41a\") "
Oct 30 22:30:20.273292 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.273242    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/769ff87d-8eca-48b8-ae57-27d2347ba07d-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/769ff87d-8eca-48b8-ae57-27d2347ba07d-maas-api-service-ca\") pod \"769ff87d-8eca-48b8-ae57-27d2347ba07d\" (UID: \"769ff87d-8eca-48b8-ae57-27d2347ba07d\") "
Oct 30 22:30:20.273513 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.273487    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e05348d0-23b5-49d1-8171-17f2ccbcd41a-maas-api-service-ca" pod "e05348d0-23b5-49d1-8171-17f2ccbcd41a" (UID: "e05348d0-23b5-49d1-8171-17f2ccbcd41a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:20.273583 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.273512    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/769ff87d-8eca-48b8-ae57-27d2347ba07d-kube-api-access-pscv9\" (UniqueName: \"kubernetes.io/projected/769ff87d-8eca-48b8-ae57-27d2347ba07d-kube-api-access-pscv9\") pod \"769ff87d-8eca-48b8-ae57-27d2347ba07d\" (UID: \"769ff87d-8eca-48b8-ae57-27d2347ba07d\") "
Oct 30 22:30:20.273695 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.273673    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/769ff87d-8eca-48b8-ae57-27d2347ba07d-maas-api-service-ca" pod "769ff87d-8eca-48b8-ae57-27d2347ba07d" (UID: "769ff87d-8eca-48b8-ae57-27d2347ba07d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:20.274332 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.274304    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e05348d0-23b5-49d1-8171-17f2ccbcd41a-maas-api-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:20.274446 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.274335    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/769ff87d-8eca-48b8-ae57-27d2347ba07d-maas-api-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:20.275295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.275271    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e05348d0-23b5-49d1-8171-17f2ccbcd41a-kube-api-access-t4q4x" pod "e05348d0-23b5-49d1-8171-17f2ccbcd41a" (UID: "e05348d0-23b5-49d1-8171-17f2ccbcd41a"). InnerVolumeSpecName "kube-api-access-t4q4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:20.275420 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.275399    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/769ff87d-8eca-48b8-ae57-27d2347ba07d-kube-api-access-pscv9" pod "769ff87d-8eca-48b8-ae57-27d2347ba07d" (UID: "769ff87d-8eca-48b8-ae57-27d2347ba07d"). InnerVolumeSpecName "kube-api-access-pscv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:20.375910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.375871    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pscv9\" (UniqueName: \"kubernetes.io/projected/769ff87d-8eca-48b8-ae57-27d2347ba07d-kube-api-access-pscv9\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:20.375910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.375910    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4q4x\" (UniqueName: \"kubernetes.io/projected/e05348d0-23b5-49d1-8171-17f2ccbcd41a-kube-api-access-t4q4x\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:20.811264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.811235    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"
Oct 30 22:30:20.811471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.811283    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf" event={"ID":"e05348d0-23b5-49d1-8171-17f2ccbcd41a","Type":"ContainerDied","Data":"8a8b0224f4f17673e90b8dd77e430a91628d8566a8150fc58c304e825df40d56"}
Oct 30 22:30:20.811471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.811355    5258 scope.go:122] "RemoveContainer" containerID="decc411fc7889d91bdad2c5061241bfd5a704c54a8a6e1be88c164d33a4158a0"
Oct 30 22:30:20.813066 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.813033    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf" event={"ID":"769ff87d-8eca-48b8-ae57-27d2347ba07d","Type":"ContainerDied","Data":"5ed6a0a5bfb7802de830b68e303b76528bad31dd5a1ef5e57aeadc6eb43a53f2"}
Oct 30 22:30:20.813180 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.813086    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"
Oct 30 22:30:20.826893 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.826871    5258 scope.go:122] "RemoveContainer" containerID="8d7a2c444514685e33c60ecdcc61834f2e4129ab8ec9d1e2e18c7d369dbea02c"
Oct 30 22:30:20.983973 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.983937    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"]
Oct 30 22:30:20.993221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:20.993186    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-13b8d8-29889990-6wzbf"]
Oct 30 22:30:21.103291 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:21.103208    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"]
Oct 30 22:30:21.114006 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:21.113977    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-075cbb-29889990-6w7wf"]
Oct 30 22:30:21.383174 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:21.383092    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="769ff87d-8eca-48b8-ae57-27d2347ba07d" path="/var/lib/kubelet/pods/769ff87d-8eca-48b8-ae57-27d2347ba07d/volumes"
Oct 30 22:30:21.383711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:21.383689    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e05348d0-23b5-49d1-8171-17f2ccbcd41a" path="/var/lib/kubelet/pods/e05348d0-23b5-49d1-8171-17f2ccbcd41a/volumes"
Oct 30 22:30:22.393970 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:22.393931    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:22.631769 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:22.631738    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:23.325641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:23.325149    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:23.562614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:23.561688    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:25.733199 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:25.733166    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:27.052176 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:27.052107    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:27.351327 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:27.351297    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:27.708826 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:27.708730    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:29.237617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:29.237568    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:29.503082 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:29.502993    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:30.298323 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.298290    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:30.429853 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.429822    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"]
Oct 30 22:30:30.430082 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.430057    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6" podUID="8e656e61-b054-463d-be01-3f1fa44ebfe1" containerName="maas-api" containerID="cri-o://b90bedded5276418fa0a7b875e3766b2a7d714e727ad79ce22cbed9892a30ad5" gracePeriod=30
Oct 30 22:30:30.535176 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.535143    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:30.751813 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.751789    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:30:30.849521 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.849485    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:30.853692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.853663    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-metrics-certs\") pod \"8e656e61-b054-463d-be01-3f1fa44ebfe1\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") "
Oct 30 22:30:30.853871 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.853718    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-maas-api-tls\") pod \"8e656e61-b054-463d-be01-3f1fa44ebfe1\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") "
Oct 30 22:30:30.853946 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.853871    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8e656e61-b054-463d-be01-3f1fa44ebfe1-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e656e61-b054-463d-be01-3f1fa44ebfe1-openshift-service-ca\") pod \"8e656e61-b054-463d-be01-3f1fa44ebfe1\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") "
Oct 30 22:30:30.854044 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.854023    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e656e61-b054-463d-be01-3f1fa44ebfe1-kube-api-access-v4wpz\" (UniqueName: \"kubernetes.io/projected/8e656e61-b054-463d-be01-3f1fa44ebfe1-kube-api-access-v4wpz\") pod \"8e656e61-b054-463d-be01-3f1fa44ebfe1\" (UID: \"8e656e61-b054-463d-be01-3f1fa44ebfe1\") "
Oct 30 22:30:30.854265 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.854239    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e656e61-b054-463d-be01-3f1fa44ebfe1-openshift-service-ca" pod "8e656e61-b054-463d-be01-3f1fa44ebfe1" (UID: "8e656e61-b054-463d-be01-3f1fa44ebfe1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:30.855036 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.855010    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e656e61-b054-463d-be01-3f1fa44ebfe1-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:30.856062 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.856038    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-maas-api-tls" pod "8e656e61-b054-463d-be01-3f1fa44ebfe1" (UID: "8e656e61-b054-463d-be01-3f1fa44ebfe1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:30:30.856778 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.856735    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e656e61-b054-463d-be01-3f1fa44ebfe1-kube-api-access-v4wpz" pod "8e656e61-b054-463d-be01-3f1fa44ebfe1" (UID: "8e656e61-b054-463d-be01-3f1fa44ebfe1"). InnerVolumeSpecName "kube-api-access-v4wpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:30.857119 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.857094    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-metrics-certs" pod "8e656e61-b054-463d-be01-3f1fa44ebfe1" (UID: "8e656e61-b054-463d-be01-3f1fa44ebfe1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:30:30.914400 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.914361    5258 generic.go:356] "Generic (PLEG): container finished" podID="8e656e61-b054-463d-be01-3f1fa44ebfe1" containerID="b90bedded5276418fa0a7b875e3766b2a7d714e727ad79ce22cbed9892a30ad5" exitCode=0
Oct 30 22:30:30.914640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.914414    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"
Oct 30 22:30:30.914640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.914464    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6" event={"ID":"8e656e61-b054-463d-be01-3f1fa44ebfe1","Type":"ContainerDied","Data":"b90bedded5276418fa0a7b875e3766b2a7d714e727ad79ce22cbed9892a30ad5"}
Oct 30 22:30:30.914640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.914563    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6" event={"ID":"8e656e61-b054-463d-be01-3f1fa44ebfe1","Type":"ContainerDied","Data":"0c5c3bd74fea64f237dabc4588a401cf941f937e39fc84f1988ff87dcb38a391"}
Oct 30 22:30:30.914640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.914639    5258 scope.go:122] "RemoveContainer" containerID="b90bedded5276418fa0a7b875e3766b2a7d714e727ad79ce22cbed9892a30ad5"
Oct 30 22:30:30.938429 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.938411    5258 scope.go:122] "RemoveContainer" containerID="b90bedded5276418fa0a7b875e3766b2a7d714e727ad79ce22cbed9892a30ad5"
Oct 30 22:30:30.938902 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:30:30.938874    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b90bedded5276418fa0a7b875e3766b2a7d714e727ad79ce22cbed9892a30ad5\": container with ID starting with b90bedded5276418fa0a7b875e3766b2a7d714e727ad79ce22cbed9892a30ad5 not found: ID does not exist" containerID="b90bedded5276418fa0a7b875e3766b2a7d714e727ad79ce22cbed9892a30ad5"
Oct 30 22:30:30.939038 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.938906    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b90bedded5276418fa0a7b875e3766b2a7d714e727ad79ce22cbed9892a30ad5"} err="failed to get container status \"b90bedded5276418fa0a7b875e3766b2a7d714e727ad79ce22cbed9892a30ad5\": rpc error: code = NotFound desc = could not find container \"b90bedded5276418fa0a7b875e3766b2a7d714e727ad79ce22cbed9892a30ad5\": container with ID starting with b90bedded5276418fa0a7b875e3766b2a7d714e727ad79ce22cbed9892a30ad5 not found: ID does not exist"
Oct 30 22:30:30.956912 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.956887    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4wpz\" (UniqueName: \"kubernetes.io/projected/8e656e61-b054-463d-be01-3f1fa44ebfe1-kube-api-access-v4wpz\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:30.956912 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.956913    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:30.957074 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:30.956924    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e656e61-b054-463d-be01-3f1fa44ebfe1-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:31.083339 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:31.083307    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"]
Oct 30 22:30:31.088691 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:31.088656    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afe802-9c4db786c-xbjl6"]
Oct 30 22:30:31.382889 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:31.382836    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8e656e61-b054-463d-be01-3f1fa44ebfe1" path="/var/lib/kubelet/pods/8e656e61-b054-463d-be01-3f1fa44ebfe1/volumes"
Oct 30 22:30:32.265386 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:32.265345    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:32.608892 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:32.608857    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:32.839038 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:32.838993    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:33.289489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:33.289453    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:34.114158 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:34.114116    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:34.424007 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:34.423918    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:34.721171 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:34.721082    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:38.023709 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:38.023667    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:40.524294 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:40.524257    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:40.801351 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:40.801260    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:41.022245 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:41.022196    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:41.795551 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:41.795506    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:43.162883 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:30:43.162848    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:30:43.385820 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:43.385784    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:46.940009 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:46.939970    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:47.227369 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:47.227289    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:30:48.937215 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:48.937177    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:53.825316 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:53.825278    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"]
Oct 30 22:30:53.938783 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:53.938732    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"]
Oct 30 22:30:54.319825 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:54.319783    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:54.546972 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:54.546931    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:54.816580 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:54.811151    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:58.825882 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:58.825796    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj" podUID="3dd9adb3-a2d7-4f2b-8985-d043bf78cecc" containerName="payload-processing" containerID="cri-o://e5b1c5a11b2870c20e2a699090d70729529212c86ec91de030bcf9739f165de6" gracePeriod=25
Oct 30 22:30:58.939896 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:58.939859    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff" podUID="1e670da5-3e9a-4d99-a5e6-d1251d5efcc7" containerName="payload-pre-processing" containerID="cri-o://f39ec6896fe849b7fddd0b31371c9a9edc6fd05a3102c902c40662c5c7eacd79" gracePeriod=25
Oct 30 22:30:59.285768 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.285650    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"]
Oct 30 22:30:59.286014 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.285902    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f" podUID="285e9bb2-0d1c-48c4-a48d-48d2f3b2aace" containerName="maas-api" containerID="cri-o://a0140a4d5e305ba97cdcd970e0ffc82d7a380cad0384c8863844231326f3c972" gracePeriod=30
Oct 30 22:30:59.485678 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.485641    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:59.612027 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.612006    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:30:59.699614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.699176    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-kube-api-access-nslbh\" (UniqueName: \"kubernetes.io/projected/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-kube-api-access-nslbh\") pod \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") "
Oct 30 22:30:59.699614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.699235    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-openshift-service-ca\") pod \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") "
Oct 30 22:30:59.699614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.699323    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-maas-api-tls\") pod \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") "
Oct 30 22:30:59.699614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.699371    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-metrics-certs\" (UniqueName: \"kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-metrics-certs\") pod \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\" (UID: \"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace\") "
Oct 30 22:30:59.717413 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.717086    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-kube-api-access-nslbh" pod "285e9bb2-0d1c-48c4-a48d-48d2f3b2aace" (UID: "285e9bb2-0d1c-48c4-a48d-48d2f3b2aace"). InnerVolumeSpecName "kube-api-access-nslbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:59.736200 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.730804    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-openshift-service-ca" pod "285e9bb2-0d1c-48c4-a48d-48d2f3b2aace" (UID: "285e9bb2-0d1c-48c4-a48d-48d2f3b2aace"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:59.746850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.745919    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-maas-api-tls" pod "285e9bb2-0d1c-48c4-a48d-48d2f3b2aace" (UID: "285e9bb2-0d1c-48c4-a48d-48d2f3b2aace"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:30:59.755644 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.755413    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-metrics-certs" pod "285e9bb2-0d1c-48c4-a48d-48d2f3b2aace" (UID: "285e9bb2-0d1c-48c4-a48d-48d2f3b2aace"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:30:59.801700 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.801645    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nslbh\" (UniqueName: \"kubernetes.io/projected/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-kube-api-access-nslbh\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:59.801700 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.801679    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:59.801700 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.801695    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:59.801700 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:30:59.801710    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:00.179444 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:00.179407    5258 generic.go:356] "Generic (PLEG): container finished" podID="285e9bb2-0d1c-48c4-a48d-48d2f3b2aace" containerID="a0140a4d5e305ba97cdcd970e0ffc82d7a380cad0384c8863844231326f3c972" exitCode=0
Oct 30 22:31:00.179910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:00.179455    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"
Oct 30 22:31:00.179910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:00.179504    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f" event={"ID":"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace","Type":"ContainerDied","Data":"a0140a4d5e305ba97cdcd970e0ffc82d7a380cad0384c8863844231326f3c972"}
Oct 30 22:31:00.179910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:00.179613    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f" event={"ID":"285e9bb2-0d1c-48c4-a48d-48d2f3b2aace","Type":"ContainerDied","Data":"25bbccb9de3deb2a5592544b62870527a26ad769523d79e90d2e495ea0106942"}
Oct 30 22:31:00.179910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:00.179646    5258 scope.go:122] "RemoveContainer" containerID="a0140a4d5e305ba97cdcd970e0ffc82d7a380cad0384c8863844231326f3c972"
Oct 30 22:31:00.192119 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:00.192100    5258 scope.go:122] "RemoveContainer" containerID="a0140a4d5e305ba97cdcd970e0ffc82d7a380cad0384c8863844231326f3c972"
Oct 30 22:31:00.192434 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:00.192415    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0140a4d5e305ba97cdcd970e0ffc82d7a380cad0384c8863844231326f3c972\": container with ID starting with a0140a4d5e305ba97cdcd970e0ffc82d7a380cad0384c8863844231326f3c972 not found: ID does not exist" containerID="a0140a4d5e305ba97cdcd970e0ffc82d7a380cad0384c8863844231326f3c972"
Oct 30 22:31:00.192515 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:00.192442    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0140a4d5e305ba97cdcd970e0ffc82d7a380cad0384c8863844231326f3c972"} err="failed to get container status \"a0140a4d5e305ba97cdcd970e0ffc82d7a380cad0384c8863844231326f3c972\": rpc error: code = NotFound desc = could not find container \"a0140a4d5e305ba97cdcd970e0ffc82d7a380cad0384c8863844231326f3c972\": container with ID starting with a0140a4d5e305ba97cdcd970e0ffc82d7a380cad0384c8863844231326f3c972 not found: ID does not exist"
Oct 30 22:31:00.359793 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:00.359735    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"]
Oct 30 22:31:00.369165 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:00.369133    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-8e1227-758c869cc9-vpc4f"]
Oct 30 22:31:01.045642 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:01.045572    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:01.280600 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:01.280559    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:01.383432 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:01.383398    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="285e9bb2-0d1c-48c4-a48d-48d2f3b2aace" path="/var/lib/kubelet/pods/285e9bb2-0d1c-48c4-a48d-48d2f3b2aace/volumes"
Oct 30 22:31:01.498629 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:01.498580    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:01.552870 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:01.552771    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff" podUID="1e670da5-3e9a-4d99-a5e6-d1251d5efcc7" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:31:01.553249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:01.553217    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj" podUID="3dd9adb3-a2d7-4f2b-8985-d043bf78cecc" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:31:02.053846 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:02.053805    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:06.646376 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:06.646338    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:09.709983 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:09.709929    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:09.955478 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:09.955428    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:10.033048 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:10.032955    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"]
Oct 30 22:31:10.033350 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:10.033321    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc" podUID="bdc948e1-3516-469d-a39f-8531663ea68c" containerName="istio-proxy" containerID="cri-o://feb702b3abbbe0513faf0c3a7aba2bcba9e22988a664ad31c96e76caed10a14b" gracePeriod=30
Oct 30 22:31:10.185288 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:10.185250    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:11.552568 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:11.552533    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff" podUID="1e670da5-3e9a-4d99-a5e6-d1251d5efcc7" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:31:11.552996 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:11.552803    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj" podUID="3dd9adb3-a2d7-4f2b-8985-d043bf78cecc" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:31:11.859948 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:11.859905    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:13.162376 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:13.162339    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:31:15.310223 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.310198    5258 generic.go:356] "Generic (PLEG): container finished" podID="bdc948e1-3516-469d-a39f-8531663ea68c" containerID="feb702b3abbbe0513faf0c3a7aba2bcba9e22988a664ad31c96e76caed10a14b" exitCode=0
Oct 30 22:31:15.310573 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.310233    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc" event={"ID":"bdc948e1-3516-469d-a39f-8531663ea68c","Type":"ContainerDied","Data":"feb702b3abbbe0513faf0c3a7aba2bcba9e22988a664ad31c96e76caed10a14b"}
Oct 30 22:31:15.310573 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.310280    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc" event={"ID":"bdc948e1-3516-469d-a39f-8531663ea68c","Type":"ContainerDied","Data":"0d0f159cdff8bc6856f9079b4448ac19e9f3f8b023caa97e2ad489916f1a36b0"}
Oct 30 22:31:15.310573 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.310299    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d0f159cdff8bc6856f9079b4448ac19e9f3f8b023caa97e2ad489916f1a36b0"
Oct 30 22:31:15.310573 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.310314    5258 scope.go:122] "RemoveContainer" containerID="d5eeb1f867c442973dd217d6460bd719fe0c95e91bb68926db53046b60ee7fac"
Oct 30 22:31:15.315132 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.315112    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:31:15.410886 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.410851    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-workload-certs\") pod \"bdc948e1-3516-469d-a39f-8531663ea68c\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") "
Oct 30 22:31:15.411036 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.410894    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bdc948e1-3516-469d-a39f-8531663ea68c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc948e1-3516-469d-a39f-8531663ea68c-istio-podinfo\") pod \"bdc948e1-3516-469d-a39f-8531663ea68c\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") "
Oct 30 22:31:15.411036 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.410960    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-istio-envoy\") pod \"bdc948e1-3516-469d-a39f-8531663ea68c\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") "
Oct 30 22:31:15.411036 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.411008    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-credential-socket\") pod \"bdc948e1-3516-469d-a39f-8531663ea68c\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") "
Oct 30 22:31:15.411202 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.411104    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bdc948e1-3516-469d-a39f-8531663ea68c-kube-api-access-6s4ww\" (UniqueName: \"kubernetes.io/projected/bdc948e1-3516-469d-a39f-8531663ea68c-kube-api-access-6s4ww\") pod \"bdc948e1-3516-469d-a39f-8531663ea68c\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") "
Oct 30 22:31:15.411202 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.411177    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-istio-data\") pod \"bdc948e1-3516-469d-a39f-8531663ea68c\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") "
Oct 30 22:31:15.411311 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.411103    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-workload-certs" pod "bdc948e1-3516-469d-a39f-8531663ea68c" (UID: "bdc948e1-3516-469d-a39f-8531663ea68c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:15.411311 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.411252    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bdc948e1-3516-469d-a39f-8531663ea68c-istio-token\" (UniqueName: \"kubernetes.io/projected/bdc948e1-3516-469d-a39f-8531663ea68c-istio-token\") pod \"bdc948e1-3516-469d-a39f-8531663ea68c\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") "
Oct 30 22:31:15.411311 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.411301    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-credential-socket" pod "bdc948e1-3516-469d-a39f-8531663ea68c" (UID: "bdc948e1-3516-469d-a39f-8531663ea68c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:15.411475 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.411321    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bdc948e1-3516-469d-a39f-8531663ea68c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc948e1-3516-469d-a39f-8531663ea68c-istiod-ca-cert\") pod \"bdc948e1-3516-469d-a39f-8531663ea68c\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") "
Oct 30 22:31:15.411475 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.411352    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-workload-socket\") pod \"bdc948e1-3516-469d-a39f-8531663ea68c\" (UID: \"bdc948e1-3516-469d-a39f-8531663ea68c\") "
Oct 30 22:31:15.411581 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.411502    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-istio-data" pod "bdc948e1-3516-469d-a39f-8531663ea68c" (UID: "bdc948e1-3516-469d-a39f-8531663ea68c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:15.411772 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.411751    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-workload-socket" pod "bdc948e1-3516-469d-a39f-8531663ea68c" (UID: "bdc948e1-3516-469d-a39f-8531663ea68c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:15.411991 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.411973    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:15.412101 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.412086    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:15.412187 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.412105    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:15.412187 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.412118    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:15.412187 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.411760    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdc948e1-3516-469d-a39f-8531663ea68c-istiod-ca-cert" pod "bdc948e1-3516-469d-a39f-8531663ea68c" (UID: "bdc948e1-3516-469d-a39f-8531663ea68c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:31:15.413230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.413200    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bdc948e1-3516-469d-a39f-8531663ea68c-istio-podinfo" pod "bdc948e1-3516-469d-a39f-8531663ea68c" (UID: "bdc948e1-3516-469d-a39f-8531663ea68c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:31:15.413391 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.413368    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdc948e1-3516-469d-a39f-8531663ea68c-kube-api-access-6s4ww" pod "bdc948e1-3516-469d-a39f-8531663ea68c" (UID: "bdc948e1-3516-469d-a39f-8531663ea68c"). InnerVolumeSpecName "kube-api-access-6s4ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:15.413544 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.413519    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-istio-envoy" pod "bdc948e1-3516-469d-a39f-8531663ea68c" (UID: "bdc948e1-3516-469d-a39f-8531663ea68c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:15.413669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.413569    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdc948e1-3516-469d-a39f-8531663ea68c-istio-token" pod "bdc948e1-3516-469d-a39f-8531663ea68c" (UID: "bdc948e1-3516-469d-a39f-8531663ea68c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:15.513188 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.513152    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdc948e1-3516-469d-a39f-8531663ea68c-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:15.513188 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.513192    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s4ww\" (UniqueName: \"kubernetes.io/projected/bdc948e1-3516-469d-a39f-8531663ea68c-kube-api-access-6s4ww\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:15.513373 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.513206    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdc948e1-3516-469d-a39f-8531663ea68c-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:15.513373 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.513219    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdc948e1-3516-469d-a39f-8531663ea68c-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:15.513373 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:15.513233    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdc948e1-3516-469d-a39f-8531663ea68c-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:16.319071 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:16.319032    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"
Oct 30 22:31:16.591211 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:16.591131    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"]
Oct 30 22:31:16.599637 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:16.599601    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w0-8e1227-openshift-default-8666d5657c-zdlwc"]
Oct 30 22:31:17.426142 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:17.426082    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bdc948e1-3516-469d-a39f-8531663ea68c" path="/var/lib/kubelet/pods/bdc948e1-3516-469d-a39f-8531663ea68c/volumes"
Oct 30 22:31:17.470320 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:17.470277    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:19.119726 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.119694    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"
Oct 30 22:31:19.163977 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.163936    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc-plugins-config-volume\") pod \"3dd9adb3-a2d7-4f2b-8985-d043bf78cecc\" (UID: \"3dd9adb3-a2d7-4f2b-8985-d043bf78cecc\") "
Oct 30 22:31:19.164175 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.164083    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc-kube-api-access-tcg4t\" (UniqueName: \"kubernetes.io/projected/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc-kube-api-access-tcg4t\") pod \"3dd9adb3-a2d7-4f2b-8985-d043bf78cecc\" (UID: \"3dd9adb3-a2d7-4f2b-8985-d043bf78cecc\") "
Oct 30 22:31:19.164662 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.164353    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc-plugins-config-volume" pod "3dd9adb3-a2d7-4f2b-8985-d043bf78cecc" (UID: "3dd9adb3-a2d7-4f2b-8985-d043bf78cecc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:31:19.164838 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.164807    5258 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc-plugins-config-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:19.166991 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.166959    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc-kube-api-access-tcg4t" pod "3dd9adb3-a2d7-4f2b-8985-d043bf78cecc" (UID: "3dd9adb3-a2d7-4f2b-8985-d043bf78cecc"). InnerVolumeSpecName "kube-api-access-tcg4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:19.214368 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.214346    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"
Oct 30 22:31:19.265436 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.265408    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7-kube-api-access-hbpxr\" (UniqueName: \"kubernetes.io/projected/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7-kube-api-access-hbpxr\") pod \"1e670da5-3e9a-4d99-a5e6-d1251d5efcc7\" (UID: \"1e670da5-3e9a-4d99-a5e6-d1251d5efcc7\") "
Oct 30 22:31:19.265607 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.265445    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7-plugins-config-volume\") pod \"1e670da5-3e9a-4d99-a5e6-d1251d5efcc7\" (UID: \"1e670da5-3e9a-4d99-a5e6-d1251d5efcc7\") "
Oct 30 22:31:19.265944 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.265911    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7-plugins-config-volume" pod "1e670da5-3e9a-4d99-a5e6-d1251d5efcc7" (UID: "1e670da5-3e9a-4d99-a5e6-d1251d5efcc7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:31:19.266358 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.266308    5258 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7-plugins-config-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:19.266438 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.266363    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcg4t\" (UniqueName: \"kubernetes.io/projected/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc-kube-api-access-tcg4t\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:19.268540 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.268509    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7-kube-api-access-hbpxr" pod "1e670da5-3e9a-4d99-a5e6-d1251d5efcc7" (UID: "1e670da5-3e9a-4d99-a5e6-d1251d5efcc7"). InnerVolumeSpecName "kube-api-access-hbpxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:19.346571 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.346495    5258 generic.go:356] "Generic (PLEG): container finished" podID="1e670da5-3e9a-4d99-a5e6-d1251d5efcc7" containerID="f39ec6896fe849b7fddd0b31371c9a9edc6fd05a3102c902c40662c5c7eacd79" exitCode=0
Oct 30 22:31:19.346571 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.346559    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"
Oct 30 22:31:19.346803 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.346558    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff" event={"ID":"1e670da5-3e9a-4d99-a5e6-d1251d5efcc7","Type":"ContainerDied","Data":"f39ec6896fe849b7fddd0b31371c9a9edc6fd05a3102c902c40662c5c7eacd79"}
Oct 30 22:31:19.346803 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.346690    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff" event={"ID":"1e670da5-3e9a-4d99-a5e6-d1251d5efcc7","Type":"ContainerDied","Data":"e1d93da595defc561151d8a2e203e907385d107d16bb0fe7b5fbbcefa12ae33e"}
Oct 30 22:31:19.346803 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.346716    5258 scope.go:122] "RemoveContainer" containerID="f39ec6896fe849b7fddd0b31371c9a9edc6fd05a3102c902c40662c5c7eacd79"
Oct 30 22:31:19.348414 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.348389    5258 generic.go:356] "Generic (PLEG): container finished" podID="3dd9adb3-a2d7-4f2b-8985-d043bf78cecc" containerID="e5b1c5a11b2870c20e2a699090d70729529212c86ec91de030bcf9739f165de6" exitCode=0
Oct 30 22:31:19.348528 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.348436    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"
Oct 30 22:31:19.348528 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.348490    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj" event={"ID":"3dd9adb3-a2d7-4f2b-8985-d043bf78cecc","Type":"ContainerDied","Data":"e5b1c5a11b2870c20e2a699090d70729529212c86ec91de030bcf9739f165de6"}
Oct 30 22:31:19.348653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.348568    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj" event={"ID":"3dd9adb3-a2d7-4f2b-8985-d043bf78cecc","Type":"ContainerDied","Data":"01cdd8d6f7dc85a6750da4c4192732575316f97e65a8e3e7f86a41530bd915c2"}
Oct 30 22:31:19.360130 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.360094    5258 scope.go:122] "RemoveContainer" containerID="f39ec6896fe849b7fddd0b31371c9a9edc6fd05a3102c902c40662c5c7eacd79"
Oct 30 22:31:19.360580 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:19.360488    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f39ec6896fe849b7fddd0b31371c9a9edc6fd05a3102c902c40662c5c7eacd79\": container with ID starting with f39ec6896fe849b7fddd0b31371c9a9edc6fd05a3102c902c40662c5c7eacd79 not found: ID does not exist" containerID="f39ec6896fe849b7fddd0b31371c9a9edc6fd05a3102c902c40662c5c7eacd79"
Oct 30 22:31:19.360580 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.360525    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f39ec6896fe849b7fddd0b31371c9a9edc6fd05a3102c902c40662c5c7eacd79"} err="failed to get container status \"f39ec6896fe849b7fddd0b31371c9a9edc6fd05a3102c902c40662c5c7eacd79\": rpc error: code = NotFound desc = could not find container \"f39ec6896fe849b7fddd0b31371c9a9edc6fd05a3102c902c40662c5c7eacd79\": container with ID starting with f39ec6896fe849b7fddd0b31371c9a9edc6fd05a3102c902c40662c5c7eacd79 not found: ID does not exist"
Oct 30 22:31:19.360580 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.360568    5258 scope.go:122] "RemoveContainer" containerID="e5b1c5a11b2870c20e2a699090d70729529212c86ec91de030bcf9739f165de6"
Oct 30 22:31:19.367844 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.367818    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbpxr\" (UniqueName: \"kubernetes.io/projected/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7-kube-api-access-hbpxr\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:19.376387 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.376369    5258 scope.go:122] "RemoveContainer" containerID="e5b1c5a11b2870c20e2a699090d70729529212c86ec91de030bcf9739f165de6"
Oct 30 22:31:19.376884 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:19.376820    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5b1c5a11b2870c20e2a699090d70729529212c86ec91de030bcf9739f165de6\": container with ID starting with e5b1c5a11b2870c20e2a699090d70729529212c86ec91de030bcf9739f165de6 not found: ID does not exist" containerID="e5b1c5a11b2870c20e2a699090d70729529212c86ec91de030bcf9739f165de6"
Oct 30 22:31:19.376884 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.376858    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5b1c5a11b2870c20e2a699090d70729529212c86ec91de030bcf9739f165de6"} err="failed to get container status \"e5b1c5a11b2870c20e2a699090d70729529212c86ec91de030bcf9739f165de6\": rpc error: code = NotFound desc = could not find container \"e5b1c5a11b2870c20e2a699090d70729529212c86ec91de030bcf9739f165de6\": container with ID starting with e5b1c5a11b2870c20e2a699090d70729529212c86ec91de030bcf9739f165de6 not found: ID does not exist"
Oct 30 22:31:19.575866 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.575829    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"]
Oct 30 22:31:19.580961 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.580933    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-13b8d8-675594984c-jd5pj"]
Oct 30 22:31:19.711890 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.711807    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"]
Oct 30 22:31:19.726524 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:19.726487    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-13b8d8-bcb7c7b4c-vbtff"]
Oct 30 22:31:21.385898 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:21.385863    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1e670da5-3e9a-4d99-a5e6-d1251d5efcc7" path="/var/lib/kubelet/pods/1e670da5-3e9a-4d99-a5e6-d1251d5efcc7/volumes"
Oct 30 22:31:21.386585 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:21.386566    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3dd9adb3-a2d7-4f2b-8985-d043bf78cecc" path="/var/lib/kubelet/pods/3dd9adb3-a2d7-4f2b-8985-d043bf78cecc/volumes"
Oct 30 22:31:21.805743 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:21.805648    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"]
Oct 30 22:31:21.805919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:21.805882    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp" podUID="f9cf2d59-e154-45ce-864e-675a1251feee" containerName="maas-api" containerID="cri-o://467e967d010df484da201ba651dfa9053305b8585af0a10bef48f90cecc5e8a7" gracePeriod=30
Oct 30 22:31:22.032545 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.031220    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:22.149860 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.149836    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:31:22.224140 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.224103    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f9cf2d59-e154-45ce-864e-675a1251feee-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9cf2d59-e154-45ce-864e-675a1251feee-openshift-service-ca\") pod \"f9cf2d59-e154-45ce-864e-675a1251feee\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") "
Oct 30 22:31:22.224553 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.224531    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-metrics-certs\") pod \"f9cf2d59-e154-45ce-864e-675a1251feee\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") "
Oct 30 22:31:22.224753 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.224736    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-maas-api-tls\") pod \"f9cf2d59-e154-45ce-864e-675a1251feee\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") "
Oct 30 22:31:22.224978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.224962    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9cf2d59-e154-45ce-864e-675a1251feee-kube-api-access-zmcwx\" (UniqueName: \"kubernetes.io/projected/f9cf2d59-e154-45ce-864e-675a1251feee-kube-api-access-zmcwx\") pod \"f9cf2d59-e154-45ce-864e-675a1251feee\" (UID: \"f9cf2d59-e154-45ce-864e-675a1251feee\") "
Oct 30 22:31:22.231614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.225557    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9cf2d59-e154-45ce-864e-675a1251feee-openshift-service-ca" pod "f9cf2d59-e154-45ce-864e-675a1251feee" (UID: "f9cf2d59-e154-45ce-864e-675a1251feee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:31:22.232057 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.232035    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9cf2d59-e154-45ce-864e-675a1251feee-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:22.234507 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.234473    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-metrics-certs" pod "f9cf2d59-e154-45ce-864e-675a1251feee" (UID: "f9cf2d59-e154-45ce-864e-675a1251feee"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:31:22.234699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.234684    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-maas-api-tls" pod "f9cf2d59-e154-45ce-864e-675a1251feee" (UID: "f9cf2d59-e154-45ce-864e-675a1251feee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:31:22.247981 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.247946    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9cf2d59-e154-45ce-864e-675a1251feee-kube-api-access-zmcwx" pod "f9cf2d59-e154-45ce-864e-675a1251feee" (UID: "f9cf2d59-e154-45ce-864e-675a1251feee"). InnerVolumeSpecName "kube-api-access-zmcwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:22.333697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.333664    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:22.333697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.333695    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9cf2d59-e154-45ce-864e-675a1251feee-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:22.333934 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.333709    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmcwx\" (UniqueName: \"kubernetes.io/projected/f9cf2d59-e154-45ce-864e-675a1251feee-kube-api-access-zmcwx\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:22.377777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.377675    5258 generic.go:356] "Generic (PLEG): container finished" podID="f9cf2d59-e154-45ce-864e-675a1251feee" containerID="467e967d010df484da201ba651dfa9053305b8585af0a10bef48f90cecc5e8a7" exitCode=0
Oct 30 22:31:22.377777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.377706    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"
Oct 30 22:31:22.377777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.377738    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp" event={"ID":"f9cf2d59-e154-45ce-864e-675a1251feee","Type":"ContainerDied","Data":"467e967d010df484da201ba651dfa9053305b8585af0a10bef48f90cecc5e8a7"}
Oct 30 22:31:22.378080 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.377782    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp" event={"ID":"f9cf2d59-e154-45ce-864e-675a1251feee","Type":"ContainerDied","Data":"eaa000cb51601b264b85e481bfd82a84cf02cb7e93eae31e3e0a9c7b112878e8"}
Oct 30 22:31:22.378080 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.377810    5258 scope.go:122] "RemoveContainer" containerID="467e967d010df484da201ba651dfa9053305b8585af0a10bef48f90cecc5e8a7"
Oct 30 22:31:22.393130 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.393111    5258 scope.go:122] "RemoveContainer" containerID="467e967d010df484da201ba651dfa9053305b8585af0a10bef48f90cecc5e8a7"
Oct 30 22:31:22.393479 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:22.393406    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"467e967d010df484da201ba651dfa9053305b8585af0a10bef48f90cecc5e8a7\": container with ID starting with 467e967d010df484da201ba651dfa9053305b8585af0a10bef48f90cecc5e8a7 not found: ID does not exist" containerID="467e967d010df484da201ba651dfa9053305b8585af0a10bef48f90cecc5e8a7"
Oct 30 22:31:22.393479 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.393439    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"467e967d010df484da201ba651dfa9053305b8585af0a10bef48f90cecc5e8a7"} err="failed to get container status \"467e967d010df484da201ba651dfa9053305b8585af0a10bef48f90cecc5e8a7\": rpc error: code = NotFound desc = could not find container \"467e967d010df484da201ba651dfa9053305b8585af0a10bef48f90cecc5e8a7\": container with ID starting with 467e967d010df484da201ba651dfa9053305b8585af0a10bef48f90cecc5e8a7 not found: ID does not exist"
Oct 30 22:31:22.412114 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:22.412087    5258 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9cf2d59_e154_45ce_864e_675a1251feee.slice/crio-eaa000cb51601b264b85e481bfd82a84cf02cb7e93eae31e3e0a9c7b112878e8\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9cf2d59_e154_45ce_864e_675a1251feee.slice\": RecentStats: unable to find data in memory cache]"
Oct 30 22:31:22.546990 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.546954    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"]
Oct 30 22:31:22.554233 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:22.554196    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp"]
Oct 30 22:31:23.036798 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.036733    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:23.072536 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.072497    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"]
Oct 30 22:31:23.072862 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.072836    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822" podUID="b7a7449a-31c0-4974-b474-914075734486" containerName="maas-api" containerID="cri-o://18ad80456c04b18826388687b185d15501655932591927b9a7892327e68f35f7" gracePeriod=30
Oct 30 22:31:23.270967 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.268964    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:23.384413 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.384372    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f9cf2d59-e154-45ce-864e-675a1251feee" path="/var/lib/kubelet/pods/f9cf2d59-e154-45ce-864e-675a1251feee/volumes"
Oct 30 22:31:23.390102 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.390072    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:31:23.390504 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.390286    5258 generic.go:356] "Generic (PLEG): container finished" podID="b7a7449a-31c0-4974-b474-914075734486" containerID="18ad80456c04b18826388687b185d15501655932591927b9a7892327e68f35f7" exitCode=0
Oct 30 22:31:23.390504 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.390319    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822" event={"ID":"b7a7449a-31c0-4974-b474-914075734486","Type":"ContainerDied","Data":"18ad80456c04b18826388687b185d15501655932591927b9a7892327e68f35f7"}
Oct 30 22:31:23.390504 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.390381    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822" event={"ID":"b7a7449a-31c0-4974-b474-914075734486","Type":"ContainerDied","Data":"1574f01947e7c6d6f3df783a40562b1f1f261e6a04bda346d92c2da4b1de5394"}
Oct 30 22:31:23.390504 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.390408    5258 scope.go:122] "RemoveContainer" containerID="18ad80456c04b18826388687b185d15501655932591927b9a7892327e68f35f7"
Oct 30 22:31:23.402737 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.402656    5258 scope.go:122] "RemoveContainer" containerID="18ad80456c04b18826388687b185d15501655932591927b9a7892327e68f35f7"
Oct 30 22:31:23.403067 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:23.402983    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18ad80456c04b18826388687b185d15501655932591927b9a7892327e68f35f7\": container with ID starting with 18ad80456c04b18826388687b185d15501655932591927b9a7892327e68f35f7 not found: ID does not exist" containerID="18ad80456c04b18826388687b185d15501655932591927b9a7892327e68f35f7"
Oct 30 22:31:23.403067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.403010    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ad80456c04b18826388687b185d15501655932591927b9a7892327e68f35f7"} err="failed to get container status \"18ad80456c04b18826388687b185d15501655932591927b9a7892327e68f35f7\": rpc error: code = NotFound desc = could not find container \"18ad80456c04b18826388687b185d15501655932591927b9a7892327e68f35f7\": container with ID starting with 18ad80456c04b18826388687b185d15501655932591927b9a7892327e68f35f7 not found: ID does not exist"
Oct 30 22:31:23.454164 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.454130    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-maas-api-tls\") pod \"b7a7449a-31c0-4974-b474-914075734486\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") "
Oct 30 22:31:23.454361 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.454235    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-metrics-certs\") pod \"b7a7449a-31c0-4974-b474-914075734486\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") "
Oct 30 22:31:23.454361 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.454350    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7a7449a-31c0-4974-b474-914075734486-kube-api-access-7dpxp\" (UniqueName: \"kubernetes.io/projected/b7a7449a-31c0-4974-b474-914075734486-kube-api-access-7dpxp\") pod \"b7a7449a-31c0-4974-b474-914075734486\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") "
Oct 30 22:31:23.454538 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.454520    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b7a7449a-31c0-4974-b474-914075734486-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a7449a-31c0-4974-b474-914075734486-openshift-service-ca\") pod \"b7a7449a-31c0-4974-b474-914075734486\" (UID: \"b7a7449a-31c0-4974-b474-914075734486\") "
Oct 30 22:31:23.454978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.454909    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7a7449a-31c0-4974-b474-914075734486-openshift-service-ca" pod "b7a7449a-31c0-4974-b474-914075734486" (UID: "b7a7449a-31c0-4974-b474-914075734486"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:31:23.455092 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.455072    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a7449a-31c0-4974-b474-914075734486-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:23.456669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.456647    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-metrics-certs" pod "b7a7449a-31c0-4974-b474-914075734486" (UID: "b7a7449a-31c0-4974-b474-914075734486"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:31:23.456752 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.456694    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7a7449a-31c0-4974-b474-914075734486-kube-api-access-7dpxp" pod "b7a7449a-31c0-4974-b474-914075734486" (UID: "b7a7449a-31c0-4974-b474-914075734486"). InnerVolumeSpecName "kube-api-access-7dpxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:23.456874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.456855    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-maas-api-tls" pod "b7a7449a-31c0-4974-b474-914075734486" (UID: "b7a7449a-31c0-4974-b474-914075734486"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:31:23.556353 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.556305    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:23.556353 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.556345    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7a7449a-31c0-4974-b474-914075734486-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:23.556639 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.556372    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dpxp\" (UniqueName: \"kubernetes.io/projected/b7a7449a-31c0-4974-b474-914075734486-kube-api-access-7dpxp\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:23.694006 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.691217    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:23.981674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:23.981546    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:24.407517 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:24.406583    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"
Oct 30 22:31:24.520926 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:24.516982    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:24.580996 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:24.580960    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"]
Oct 30 22:31:24.630226 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:24.630189    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w5-53cceb-84496676bd-m5822"]
Oct 30 22:31:24.929308 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:24.929275    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:25.050174 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:25.050135    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-fm9hp" podUID="f9cf2d59-e154-45ce-864e-675a1251feee" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.119:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:31:25.255950 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:25.255861    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:25.383232 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:25.383195    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b7a7449a-31c0-4974-b474-914075734486" path="/var/lib/kubelet/pods/b7a7449a-31c0-4974-b474-914075734486/volumes"
Oct 30 22:31:25.446491 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:25.446455    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"]
Oct 30 22:31:25.496160 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:25.496118    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w5-53cceb-v9lws"]
Oct 30 22:31:25.944234 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:25.944195    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:26.166604 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:26.166550    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:26.397024 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:26.396975    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:26.736891 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:26.736801    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:26.793450 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:26.793419    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"]
Oct 30 22:31:26.844156 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:26.844128    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-56c628-846jh"]
Oct 30 22:31:27.000090 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:26.999996    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"]
Oct 30 22:31:27.000261 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.000229    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch" podUID="57597cec-7e08-426c-ba3b-bda0d762f67e" containerName="maas-api" containerID="cri-o://bb032504eba159f62a70ae164cff4c39a4d5684a06b97ae875378031ccc3e144" gracePeriod=30
Oct 30 22:31:27.018896 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.018862    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:27.255533 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.247199    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:27.328974 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.328941    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:31:27.365454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.365407    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/57597cec-7e08-426c-ba3b-bda0d762f67e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57597cec-7e08-426c-ba3b-bda0d762f67e-maas-api-tls\") pod \"57597cec-7e08-426c-ba3b-bda0d762f67e\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") "
Oct 30 22:31:27.365678 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.365494    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57597cec-7e08-426c-ba3b-bda0d762f67e-kube-api-access-9295k\" (UniqueName: \"kubernetes.io/projected/57597cec-7e08-426c-ba3b-bda0d762f67e-kube-api-access-9295k\") pod \"57597cec-7e08-426c-ba3b-bda0d762f67e\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") "
Oct 30 22:31:27.365678 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.365621    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/57597cec-7e08-426c-ba3b-bda0d762f67e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/57597cec-7e08-426c-ba3b-bda0d762f67e-metrics-certs\") pod \"57597cec-7e08-426c-ba3b-bda0d762f67e\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") "
Oct 30 22:31:27.365826 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.365805    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/57597cec-7e08-426c-ba3b-bda0d762f67e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57597cec-7e08-426c-ba3b-bda0d762f67e-openshift-service-ca\") pod \"57597cec-7e08-426c-ba3b-bda0d762f67e\" (UID: \"57597cec-7e08-426c-ba3b-bda0d762f67e\") "
Oct 30 22:31:27.366392 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.366360    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57597cec-7e08-426c-ba3b-bda0d762f67e-openshift-service-ca" pod "57597cec-7e08-426c-ba3b-bda0d762f67e" (UID: "57597cec-7e08-426c-ba3b-bda0d762f67e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:31:27.367580 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.367557    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57597cec-7e08-426c-ba3b-bda0d762f67e-maas-api-tls" pod "57597cec-7e08-426c-ba3b-bda0d762f67e" (UID: "57597cec-7e08-426c-ba3b-bda0d762f67e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:31:27.367769 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.367754    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57597cec-7e08-426c-ba3b-bda0d762f67e-metrics-certs" pod "57597cec-7e08-426c-ba3b-bda0d762f67e" (UID: "57597cec-7e08-426c-ba3b-bda0d762f67e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:31:27.367935 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.367917    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57597cec-7e08-426c-ba3b-bda0d762f67e-kube-api-access-9295k" pod "57597cec-7e08-426c-ba3b-bda0d762f67e" (UID: "57597cec-7e08-426c-ba3b-bda0d762f67e"). InnerVolumeSpecName "kube-api-access-9295k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:27.386735 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.386703    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0685291a-5d96-43e4-86e8-70fe359214b4" path="/var/lib/kubelet/pods/0685291a-5d96-43e4-86e8-70fe359214b4/volumes"
Oct 30 22:31:27.387451 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.387430    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="74842bd9-f833-4cc2-b4e9-139741fac7ff" path="/var/lib/kubelet/pods/74842bd9-f833-4cc2-b4e9-139741fac7ff/volumes"
Oct 30 22:31:27.432776 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.432744    5258 generic.go:356] "Generic (PLEG): container finished" podID="57597cec-7e08-426c-ba3b-bda0d762f67e" containerID="bb032504eba159f62a70ae164cff4c39a4d5684a06b97ae875378031ccc3e144" exitCode=0
Oct 30 22:31:27.432961 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.432804    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"
Oct 30 22:31:27.432961 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.432847    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch" event={"ID":"57597cec-7e08-426c-ba3b-bda0d762f67e","Type":"ContainerDied","Data":"bb032504eba159f62a70ae164cff4c39a4d5684a06b97ae875378031ccc3e144"}
Oct 30 22:31:27.432961 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.432909    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch" event={"ID":"57597cec-7e08-426c-ba3b-bda0d762f67e","Type":"ContainerDied","Data":"8c83f17e7306013fa5d8f5aaff3abe60b93a93246533fbdd8267e45e8012c506"}
Oct 30 22:31:27.432961 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.432936    5258 scope.go:122] "RemoveContainer" containerID="bb032504eba159f62a70ae164cff4c39a4d5684a06b97ae875378031ccc3e144"
Oct 30 22:31:27.445731 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.445706    5258 scope.go:122] "RemoveContainer" containerID="bb032504eba159f62a70ae164cff4c39a4d5684a06b97ae875378031ccc3e144"
Oct 30 22:31:27.447843 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:27.447777    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb032504eba159f62a70ae164cff4c39a4d5684a06b97ae875378031ccc3e144\": container with ID starting with bb032504eba159f62a70ae164cff4c39a4d5684a06b97ae875378031ccc3e144 not found: ID does not exist" containerID="bb032504eba159f62a70ae164cff4c39a4d5684a06b97ae875378031ccc3e144"
Oct 30 22:31:27.448048 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.448016    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb032504eba159f62a70ae164cff4c39a4d5684a06b97ae875378031ccc3e144"} err="failed to get container status \"bb032504eba159f62a70ae164cff4c39a4d5684a06b97ae875378031ccc3e144\": rpc error: code = NotFound desc = could not find container \"bb032504eba159f62a70ae164cff4c39a4d5684a06b97ae875378031ccc3e144\": container with ID starting with bb032504eba159f62a70ae164cff4c39a4d5684a06b97ae875378031ccc3e144 not found: ID does not exist"
Oct 30 22:31:27.468197 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.468169    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57597cec-7e08-426c-ba3b-bda0d762f67e-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:27.468197 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.468196    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9295k\" (UniqueName: \"kubernetes.io/projected/57597cec-7e08-426c-ba3b-bda0d762f67e-kube-api-access-9295k\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:27.468197 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.468213    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57597cec-7e08-426c-ba3b-bda0d762f67e-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:27.468434 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.468226    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57597cec-7e08-426c-ba3b-bda0d762f67e-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:27.583644 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.579362    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"]
Oct 30 22:31:27.590512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.590416    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:27.610333 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.597788    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-963c3a-5cd87bdcff-wlsch"]
Oct 30 22:31:27.947163 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:27.947058    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:28.167855 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:28.167808    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"]
Oct 30 22:31:28.168121 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:28.168101    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-6d4d3c-t2hjv"]
Oct 30 22:31:28.170546 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:28.170513    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:28.387625 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:28.387552    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:28.675501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:28.675395    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:28.957203 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:28.957090    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:29.293261 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:29.292921    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:29.386158 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:29.386123    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1e96c175-4b69-4475-9ed9-593a932b5eca" path="/var/lib/kubelet/pods/1e96c175-4b69-4475-9ed9-593a932b5eca/volumes"
Oct 30 22:31:29.386843 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:29.386824    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="57597cec-7e08-426c-ba3b-bda0d762f67e" path="/var/lib/kubelet/pods/57597cec-7e08-426c-ba3b-bda0d762f67e/volumes"
Oct 30 22:31:29.528788 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:29.528744    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:30.032856 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:30.032824    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:30.219897 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:30.219858    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:31:31.089410 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:31.089372    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:33.367280 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:33.367227    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:33.641273 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:33.641167    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:33.683817 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:33.683774    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"]
Oct 30 22:31:33.684124 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:33.684083    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6" podUID="878e5b5e-2d16-4105-9646-98904fcce19c" containerName="istio-proxy" containerID="cri-o://c50519552fa071a24de90922e36a0acda65ca02c0da39ce7049f4b2ae4f283b0" gracePeriod=30
Oct 30 22:31:33.903056 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:33.902946    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:35.168385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:35.168352    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:35.437028 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:35.436935    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:36.041384 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:36.041337    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:36.267148 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:36.267109    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:36.492385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:36.492342    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:37.378659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:37.378621    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:37.633660 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:37.631333    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:37.857021 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:37.856976    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:38.350385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:38.350343    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:38.729198 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:38.729165    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:38.969017 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:38.968902    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:39.012080 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.012053    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:31:39.013900 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.013876    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"]
Oct 30 22:31:39.014351 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.014297    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht" podUID="f3d87229-3602-4837-bc3c-a51ddf3c4cf5" containerName="istio-proxy" containerID="cri-o://a3051ac899587421e6c01c47848805996552a30b17561b75160d0d15a62a5cfa" gracePeriod=30
Oct 30 22:31:39.088627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.088053    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-workload-certs\") pod \"878e5b5e-2d16-4105-9646-98904fcce19c\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") "
Oct 30 22:31:39.088627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.088113    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/878e5b5e-2d16-4105-9646-98904fcce19c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878e5b5e-2d16-4105-9646-98904fcce19c-istiod-ca-cert\") pod \"878e5b5e-2d16-4105-9646-98904fcce19c\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") "
Oct 30 22:31:39.088627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.088143    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-workload-socket\") pod \"878e5b5e-2d16-4105-9646-98904fcce19c\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") "
Oct 30 22:31:39.088627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.088213    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/878e5b5e-2d16-4105-9646-98904fcce19c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878e5b5e-2d16-4105-9646-98904fcce19c-istio-podinfo\") pod \"878e5b5e-2d16-4105-9646-98904fcce19c\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") "
Oct 30 22:31:39.088627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.088387    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-istio-data\") pod \"878e5b5e-2d16-4105-9646-98904fcce19c\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") "
Oct 30 22:31:39.088627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.088534    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-istio-envoy\") pod \"878e5b5e-2d16-4105-9646-98904fcce19c\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") "
Oct 30 22:31:39.088627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.088579    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/878e5b5e-2d16-4105-9646-98904fcce19c-kube-api-access-6flm8\" (UniqueName: \"kubernetes.io/projected/878e5b5e-2d16-4105-9646-98904fcce19c-kube-api-access-6flm8\") pod \"878e5b5e-2d16-4105-9646-98904fcce19c\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") "
Oct 30 22:31:39.089368 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.088697    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/878e5b5e-2d16-4105-9646-98904fcce19c-istio-token\" (UniqueName: \"kubernetes.io/projected/878e5b5e-2d16-4105-9646-98904fcce19c-istio-token\") pod \"878e5b5e-2d16-4105-9646-98904fcce19c\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") "
Oct 30 22:31:39.089368 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.088770    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-credential-socket\") pod \"878e5b5e-2d16-4105-9646-98904fcce19c\" (UID: \"878e5b5e-2d16-4105-9646-98904fcce19c\") "
Oct 30 22:31:39.103259 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.103007    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/878e5b5e-2d16-4105-9646-98904fcce19c-istiod-ca-cert" pod "878e5b5e-2d16-4105-9646-98904fcce19c" (UID: "878e5b5e-2d16-4105-9646-98904fcce19c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:31:39.103816 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.103487    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-workload-certs" pod "878e5b5e-2d16-4105-9646-98904fcce19c" (UID: "878e5b5e-2d16-4105-9646-98904fcce19c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:39.113618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.106783    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-credential-socket" pod "878e5b5e-2d16-4105-9646-98904fcce19c" (UID: "878e5b5e-2d16-4105-9646-98904fcce19c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:39.125808 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.119092    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/878e5b5e-2d16-4105-9646-98904fcce19c-kube-api-access-6flm8" pod "878e5b5e-2d16-4105-9646-98904fcce19c" (UID: "878e5b5e-2d16-4105-9646-98904fcce19c"). InnerVolumeSpecName "kube-api-access-6flm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:39.125808 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.125700    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-workload-socket" pod "878e5b5e-2d16-4105-9646-98904fcce19c" (UID: "878e5b5e-2d16-4105-9646-98904fcce19c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:39.129621 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.126202    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-istio-data" pod "878e5b5e-2d16-4105-9646-98904fcce19c" (UID: "878e5b5e-2d16-4105-9646-98904fcce19c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:39.129621 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.126854    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-istio-envoy" pod "878e5b5e-2d16-4105-9646-98904fcce19c" (UID: "878e5b5e-2d16-4105-9646-98904fcce19c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:39.132828 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.130850    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/878e5b5e-2d16-4105-9646-98904fcce19c-istio-token" pod "878e5b5e-2d16-4105-9646-98904fcce19c" (UID: "878e5b5e-2d16-4105-9646-98904fcce19c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:39.132828 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.132470    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/878e5b5e-2d16-4105-9646-98904fcce19c-istio-podinfo" pod "878e5b5e-2d16-4105-9646-98904fcce19c" (UID: "878e5b5e-2d16-4105-9646-98904fcce19c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:31:39.190910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.190871    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:39.190910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.190911    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:39.191179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.190929    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6flm8\" (UniqueName: \"kubernetes.io/projected/878e5b5e-2d16-4105-9646-98904fcce19c-kube-api-access-6flm8\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:39.191179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.190944    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878e5b5e-2d16-4105-9646-98904fcce19c-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:39.191179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.190958    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:39.191179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.190971    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:39.191179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.190986    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878e5b5e-2d16-4105-9646-98904fcce19c-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:39.191179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.190999    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878e5b5e-2d16-4105-9646-98904fcce19c-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:39.191179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.191011    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878e5b5e-2d16-4105-9646-98904fcce19c-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:39.218470 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.218434    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:39.572845 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.572805    5258 generic.go:356] "Generic (PLEG): container finished" podID="878e5b5e-2d16-4105-9646-98904fcce19c" containerID="c50519552fa071a24de90922e36a0acda65ca02c0da39ce7049f4b2ae4f283b0" exitCode=0
Oct 30 22:31:39.573003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.572881    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"
Oct 30 22:31:39.573003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.572890    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6" event={"ID":"878e5b5e-2d16-4105-9646-98904fcce19c","Type":"ContainerDied","Data":"c50519552fa071a24de90922e36a0acda65ca02c0da39ce7049f4b2ae4f283b0"}
Oct 30 22:31:39.573003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.572958    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6" event={"ID":"878e5b5e-2d16-4105-9646-98904fcce19c","Type":"ContainerDied","Data":"3c2fa40f894bc96fd4f5721bca42fe027ec6b03096621dcafbd7339452c099a6"}
Oct 30 22:31:39.573141 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.573009    5258 scope.go:122] "RemoveContainer" containerID="c50519552fa071a24de90922e36a0acda65ca02c0da39ce7049f4b2ae4f283b0"
Oct 30 22:31:39.584139 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.584115    5258 scope.go:122] "RemoveContainer" containerID="477eb3cd6be55dd5daa2ce9c8c151003b2095c03605dfe91a50e929f426afd33"
Oct 30 22:31:39.593533 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.593513    5258 scope.go:122] "RemoveContainer" containerID="c50519552fa071a24de90922e36a0acda65ca02c0da39ce7049f4b2ae4f283b0"
Oct 30 22:31:39.593820 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:39.593797    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c50519552fa071a24de90922e36a0acda65ca02c0da39ce7049f4b2ae4f283b0\": container with ID starting with c50519552fa071a24de90922e36a0acda65ca02c0da39ce7049f4b2ae4f283b0 not found: ID does not exist" containerID="c50519552fa071a24de90922e36a0acda65ca02c0da39ce7049f4b2ae4f283b0"
Oct 30 22:31:39.593879 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.593834    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50519552fa071a24de90922e36a0acda65ca02c0da39ce7049f4b2ae4f283b0"} err="failed to get container status \"c50519552fa071a24de90922e36a0acda65ca02c0da39ce7049f4b2ae4f283b0\": rpc error: code = NotFound desc = could not find container \"c50519552fa071a24de90922e36a0acda65ca02c0da39ce7049f4b2ae4f283b0\": container with ID starting with c50519552fa071a24de90922e36a0acda65ca02c0da39ce7049f4b2ae4f283b0 not found: ID does not exist"
Oct 30 22:31:39.593879 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.593852    5258 scope.go:122] "RemoveContainer" containerID="477eb3cd6be55dd5daa2ce9c8c151003b2095c03605dfe91a50e929f426afd33"
Oct 30 22:31:39.594124 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:39.594104    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"477eb3cd6be55dd5daa2ce9c8c151003b2095c03605dfe91a50e929f426afd33\": container with ID starting with 477eb3cd6be55dd5daa2ce9c8c151003b2095c03605dfe91a50e929f426afd33 not found: ID does not exist" containerID="477eb3cd6be55dd5daa2ce9c8c151003b2095c03605dfe91a50e929f426afd33"
Oct 30 22:31:39.594182 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.594130    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"477eb3cd6be55dd5daa2ce9c8c151003b2095c03605dfe91a50e929f426afd33"} err="failed to get container status \"477eb3cd6be55dd5daa2ce9c8c151003b2095c03605dfe91a50e929f426afd33\": rpc error: code = NotFound desc = could not find container \"477eb3cd6be55dd5daa2ce9c8c151003b2095c03605dfe91a50e929f426afd33\": container with ID starting with 477eb3cd6be55dd5daa2ce9c8c151003b2095c03605dfe91a50e929f426afd33 not found: ID does not exist"
Oct 30 22:31:39.751337 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.751304    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"]
Oct 30 22:31:39.800772 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:39.800744    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-53cceb-openshift-default-bbc77b495-sf7l6"]
Oct 30 22:31:40.060697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:40.060658    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:40.718021 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:40.717981    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:40.937930 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:40.937881    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:41.171709 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:41.171653    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:41.381888 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:41.381860    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="878e5b5e-2d16-4105-9646-98904fcce19c" path="/var/lib/kubelet/pods/878e5b5e-2d16-4105-9646-98904fcce19c/volumes"
Oct 30 22:31:41.509918 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:41.509847    5258 patch_prober.go:29] interesting pod/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:31:41.509918 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:41.509908    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht" podUID="f3d87229-3602-4837-bc3c-a51ddf3c4cf5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:31:42.067904 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:42.067865    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:43.163783 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:43.163745    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:31:43.257151 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:43.257119    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"]
Oct 30 22:31:43.305925 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:43.305896    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"]
Oct 30 22:31:43.309530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:43.309501    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"]
Oct 30 22:31:43.423090 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:43.423007    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:43.636261 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:43.636227    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:44.296957 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.296894    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:31:44.465188 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.465157    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-kube-api-access-jrdwb\" (UniqueName: \"kubernetes.io/projected/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-kube-api-access-jrdwb\") pod \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") "
Oct 30 22:31:44.465377 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.465218    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-credential-socket\") pod \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") "
Oct 30 22:31:44.465377 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.465284    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-data\") pod \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") "
Oct 30 22:31:44.465494 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.465423    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-envoy\") pod \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") "
Oct 30 22:31:44.465494 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.465483    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-workload-socket\") pod \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") "
Oct 30 22:31:44.465661 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.465535    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istiod-ca-cert\") pod \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") "
Oct 30 22:31:44.465661 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.465537    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-credential-socket" pod "f3d87229-3602-4837-bc3c-a51ddf3c4cf5" (UID: "f3d87229-3602-4837-bc3c-a51ddf3c4cf5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:44.465661 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.465576    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-podinfo\") pod \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") "
Oct 30 22:31:44.465661 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.465583    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-data" pod "f3d87229-3602-4837-bc3c-a51ddf3c4cf5" (UID: "f3d87229-3602-4837-bc3c-a51ddf3c4cf5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:44.465661 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.465637    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-token\" (UniqueName: \"kubernetes.io/projected/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-token\") pod \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") "
Oct 30 22:31:44.465976 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.465786    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-workload-socket" pod "f3d87229-3602-4837-bc3c-a51ddf3c4cf5" (UID: "f3d87229-3602-4837-bc3c-a51ddf3c4cf5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:44.465976 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.465806    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-workload-certs\") pod \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\" (UID: \"f3d87229-3602-4837-bc3c-a51ddf3c4cf5\") "
Oct 30 22:31:44.466561 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.466282    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-workload-certs" pod "f3d87229-3602-4837-bc3c-a51ddf3c4cf5" (UID: "f3d87229-3602-4837-bc3c-a51ddf3c4cf5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:44.466561 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.466372    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istiod-ca-cert" pod "f3d87229-3602-4837-bc3c-a51ddf3c4cf5" (UID: "f3d87229-3602-4837-bc3c-a51ddf3c4cf5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:31:44.466561 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.466449    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:44.466561 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.466500    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:44.466561 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.466516    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:44.466561 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.466532    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:44.469372 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.469239    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-envoy" pod "f3d87229-3602-4837-bc3c-a51ddf3c4cf5" (UID: "f3d87229-3602-4837-bc3c-a51ddf3c4cf5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:44.469372 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.469340    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-token" pod "f3d87229-3602-4837-bc3c-a51ddf3c4cf5" (UID: "f3d87229-3602-4837-bc3c-a51ddf3c4cf5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:44.476642 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.471763    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-kube-api-access-jrdwb" pod "f3d87229-3602-4837-bc3c-a51ddf3c4cf5" (UID: "f3d87229-3602-4837-bc3c-a51ddf3c4cf5"). InnerVolumeSpecName "kube-api-access-jrdwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:44.476642 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.475969    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-podinfo" pod "f3d87229-3602-4837-bc3c-a51ddf3c4cf5" (UID: "f3d87229-3602-4837-bc3c-a51ddf3c4cf5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:31:44.568289 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.568259    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:44.568289 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.568286    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:44.568471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.568296    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:44.568471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.568310    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:44.568471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.568321    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrdwb\" (UniqueName: \"kubernetes.io/projected/f3d87229-3602-4837-bc3c-a51ddf3c4cf5-kube-api-access-jrdwb\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:44.615394 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.615363    5258 generic.go:356] "Generic (PLEG): container finished" podID="f3d87229-3602-4837-bc3c-a51ddf3c4cf5" containerID="a3051ac899587421e6c01c47848805996552a30b17561b75160d0d15a62a5cfa" exitCode=0
Oct 30 22:31:44.615560 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.615413    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"
Oct 30 22:31:44.615560 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.615455    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht" event={"ID":"f3d87229-3602-4837-bc3c-a51ddf3c4cf5","Type":"ContainerDied","Data":"a3051ac899587421e6c01c47848805996552a30b17561b75160d0d15a62a5cfa"}
Oct 30 22:31:44.615560 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.615508    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht" event={"ID":"f3d87229-3602-4837-bc3c-a51ddf3c4cf5","Type":"ContainerDied","Data":"2d595ce5ded4ebff78ae25813ca74afb545805dca37d8f8efa59ba833553eb89"}
Oct 30 22:31:44.615560 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.615528    5258 scope.go:122] "RemoveContainer" containerID="a3051ac899587421e6c01c47848805996552a30b17561b75160d0d15a62a5cfa"
Oct 30 22:31:44.627902 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.627880    5258 scope.go:122] "RemoveContainer" containerID="a3051ac899587421e6c01c47848805996552a30b17561b75160d0d15a62a5cfa"
Oct 30 22:31:44.628188 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:44.628163    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3051ac899587421e6c01c47848805996552a30b17561b75160d0d15a62a5cfa\": container with ID starting with a3051ac899587421e6c01c47848805996552a30b17561b75160d0d15a62a5cfa not found: ID does not exist" containerID="a3051ac899587421e6c01c47848805996552a30b17561b75160d0d15a62a5cfa"
Oct 30 22:31:44.628279 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.628198    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3051ac899587421e6c01c47848805996552a30b17561b75160d0d15a62a5cfa"} err="failed to get container status \"a3051ac899587421e6c01c47848805996552a30b17561b75160d0d15a62a5cfa\": rpc error: code = NotFound desc = could not find container \"a3051ac899587421e6c01c47848805996552a30b17561b75160d0d15a62a5cfa\": container with ID starting with a3051ac899587421e6c01c47848805996552a30b17561b75160d0d15a62a5cfa not found: ID does not exist"
Oct 30 22:31:44.789071 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.789040    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"]
Oct 30 22:31:44.792503 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:44.792478    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-963c3a-openshift-default-8595756565-mmdht"]
Oct 30 22:31:45.364472 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:45.364437    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:45.382543 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:45.382515    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f3d87229-3602-4837-bc3c-a51ddf3c4cf5" path="/var/lib/kubelet/pods/f3d87229-3602-4837-bc3c-a51ddf3c4cf5/volumes"
Oct 30 22:31:45.651131 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:45.651050    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:46.114539 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:46.114504    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"]
Oct 30 22:31:46.124556 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:46.124528    5258 scope.go:122] "RemoveContainer" containerID="feb702b3abbbe0513faf0c3a7aba2bcba9e22988a664ad31c96e76caed10a14b"
Oct 30 22:31:46.232651 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:46.232616    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"]
Oct 30 22:31:46.399886 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:46.399802    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:46.642377 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:46.642337    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:46.875052 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:46.875016    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:50.065852 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:50.065799    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:50.323766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:50.305682    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:51.115649 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.115578    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l" podUID="17a688d6-2e79-4018-9c79-fc505a28f9c6" containerName="payload-processing" containerID="cri-o://17b47a78f04ece93acd0acaf2eebb95e85e362d52db83d4d9392d2e22c6c1901" gracePeriod=25
Oct 30 22:31:51.233164 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.233106    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx" podUID="9d647ad9-c005-4e6b-8451-83e8789c0bc8" containerName="payload-pre-processing" containerID="cri-o://244286c8189227c90ad07ebbe1bdddd2f7e7e47a187da35966529f7adb689089" gracePeriod=25
Oct 30 22:31:51.336063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.336025    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"]
Oct 30 22:31:51.400261 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.399882    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"
Oct 30 22:31:51.462056 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.462013    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17a688d6-2e79-4018-9c79-fc505a28f9c6-kube-api-access-vcb7h\" (UniqueName: \"kubernetes.io/projected/17a688d6-2e79-4018-9c79-fc505a28f9c6-kube-api-access-vcb7h\") pod \"17a688d6-2e79-4018-9c79-fc505a28f9c6\" (UID: \"17a688d6-2e79-4018-9c79-fc505a28f9c6\") "
Oct 30 22:31:51.462257 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.462190    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/17a688d6-2e79-4018-9c79-fc505a28f9c6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17a688d6-2e79-4018-9c79-fc505a28f9c6-plugins-config-volume\") pod \"17a688d6-2e79-4018-9c79-fc505a28f9c6\" (UID: \"17a688d6-2e79-4018-9c79-fc505a28f9c6\") "
Oct 30 22:31:51.462646 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.462618    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17a688d6-2e79-4018-9c79-fc505a28f9c6-plugins-config-volume" pod "17a688d6-2e79-4018-9c79-fc505a28f9c6" (UID: "17a688d6-2e79-4018-9c79-fc505a28f9c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:31:51.462797 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.462777    5258 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17a688d6-2e79-4018-9c79-fc505a28f9c6-plugins-config-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:51.465339 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.465309    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17a688d6-2e79-4018-9c79-fc505a28f9c6-kube-api-access-vcb7h" pod "17a688d6-2e79-4018-9c79-fc505a28f9c6" (UID: "17a688d6-2e79-4018-9c79-fc505a28f9c6"). InnerVolumeSpecName "kube-api-access-vcb7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:51.525050 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.525019    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"
Oct 30 22:31:51.563412 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.563384    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d647ad9-c005-4e6b-8451-83e8789c0bc8-kube-api-access-fh6f9\" (UniqueName: \"kubernetes.io/projected/9d647ad9-c005-4e6b-8451-83e8789c0bc8-kube-api-access-fh6f9\") pod \"9d647ad9-c005-4e6b-8451-83e8789c0bc8\" (UID: \"9d647ad9-c005-4e6b-8451-83e8789c0bc8\") "
Oct 30 22:31:51.563623 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.563519    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d647ad9-c005-4e6b-8451-83e8789c0bc8-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d647ad9-c005-4e6b-8451-83e8789c0bc8-plugins-config-volume\") pod \"9d647ad9-c005-4e6b-8451-83e8789c0bc8\" (UID: \"9d647ad9-c005-4e6b-8451-83e8789c0bc8\") "
Oct 30 22:31:51.563982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.563944    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d647ad9-c005-4e6b-8451-83e8789c0bc8-plugins-config-volume" pod "9d647ad9-c005-4e6b-8451-83e8789c0bc8" (UID: "9d647ad9-c005-4e6b-8451-83e8789c0bc8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:31:51.564117 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.564100    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcb7h\" (UniqueName: \"kubernetes.io/projected/17a688d6-2e79-4018-9c79-fc505a28f9c6-kube-api-access-vcb7h\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:51.564173 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.564125    5258 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d647ad9-c005-4e6b-8451-83e8789c0bc8-plugins-config-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:51.565565 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.565539    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d647ad9-c005-4e6b-8451-83e8789c0bc8-kube-api-access-fh6f9" pod "9d647ad9-c005-4e6b-8451-83e8789c0bc8" (UID: "9d647ad9-c005-4e6b-8451-83e8789c0bc8"). InnerVolumeSpecName "kube-api-access-fh6f9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:51.661411 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.661285    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:51.670604 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.670557    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh6f9\" (UniqueName: \"kubernetes.io/projected/9d647ad9-c005-4e6b-8451-83e8789c0bc8-kube-api-access-fh6f9\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:51.704232 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.704192    5258 generic.go:356] "Generic (PLEG): container finished" podID="17a688d6-2e79-4018-9c79-fc505a28f9c6" containerID="17b47a78f04ece93acd0acaf2eebb95e85e362d52db83d4d9392d2e22c6c1901" exitCode=0
Oct 30 22:31:51.704415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.704243    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"
Oct 30 22:31:51.704415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.704268    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l" event={"ID":"17a688d6-2e79-4018-9c79-fc505a28f9c6","Type":"ContainerDied","Data":"17b47a78f04ece93acd0acaf2eebb95e85e362d52db83d4d9392d2e22c6c1901"}
Oct 30 22:31:51.704415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.704327    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l" event={"ID":"17a688d6-2e79-4018-9c79-fc505a28f9c6","Type":"ContainerDied","Data":"fe7236e1adcab048957b6c2fb5f368946fec5afca433cf125768dfe803a1e294"}
Oct 30 22:31:51.704415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.704359    5258 scope.go:122] "RemoveContainer" containerID="17b47a78f04ece93acd0acaf2eebb95e85e362d52db83d4d9392d2e22c6c1901"
Oct 30 22:31:51.708854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.706365    5258 generic.go:356] "Generic (PLEG): container finished" podID="9d647ad9-c005-4e6b-8451-83e8789c0bc8" containerID="244286c8189227c90ad07ebbe1bdddd2f7e7e47a187da35966529f7adb689089" exitCode=0
Oct 30 22:31:51.708854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.706442    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx" event={"ID":"9d647ad9-c005-4e6b-8451-83e8789c0bc8","Type":"ContainerDied","Data":"244286c8189227c90ad07ebbe1bdddd2f7e7e47a187da35966529f7adb689089"}
Oct 30 22:31:51.708854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.706481    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx" event={"ID":"9d647ad9-c005-4e6b-8451-83e8789c0bc8","Type":"ContainerDied","Data":"8eacc06ca16ffb10a5b6eeff5d5a8ba7a643212f052a44850fdda8134962e084"}
Oct 30 22:31:51.708854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.706551    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"
Oct 30 22:31:51.719693 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.719667    5258 scope.go:122] "RemoveContainer" containerID="17b47a78f04ece93acd0acaf2eebb95e85e362d52db83d4d9392d2e22c6c1901"
Oct 30 22:31:51.720211 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:51.720180    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17b47a78f04ece93acd0acaf2eebb95e85e362d52db83d4d9392d2e22c6c1901\": container with ID starting with 17b47a78f04ece93acd0acaf2eebb95e85e362d52db83d4d9392d2e22c6c1901 not found: ID does not exist" containerID="17b47a78f04ece93acd0acaf2eebb95e85e362d52db83d4d9392d2e22c6c1901"
Oct 30 22:31:51.720295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.720221    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b47a78f04ece93acd0acaf2eebb95e85e362d52db83d4d9392d2e22c6c1901"} err="failed to get container status \"17b47a78f04ece93acd0acaf2eebb95e85e362d52db83d4d9392d2e22c6c1901\": rpc error: code = NotFound desc = could not find container \"17b47a78f04ece93acd0acaf2eebb95e85e362d52db83d4d9392d2e22c6c1901\": container with ID starting with 17b47a78f04ece93acd0acaf2eebb95e85e362d52db83d4d9392d2e22c6c1901 not found: ID does not exist"
Oct 30 22:31:51.720295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.720244    5258 scope.go:122] "RemoveContainer" containerID="244286c8189227c90ad07ebbe1bdddd2f7e7e47a187da35966529f7adb689089"
Oct 30 22:31:51.734556 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.734417    5258 scope.go:122] "RemoveContainer" containerID="244286c8189227c90ad07ebbe1bdddd2f7e7e47a187da35966529f7adb689089"
Oct 30 22:31:51.734780 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:51.734759    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"244286c8189227c90ad07ebbe1bdddd2f7e7e47a187da35966529f7adb689089\": container with ID starting with 244286c8189227c90ad07ebbe1bdddd2f7e7e47a187da35966529f7adb689089 not found: ID does not exist" containerID="244286c8189227c90ad07ebbe1bdddd2f7e7e47a187da35966529f7adb689089"
Oct 30 22:31:51.734860 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.734786    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"244286c8189227c90ad07ebbe1bdddd2f7e7e47a187da35966529f7adb689089"} err="failed to get container status \"244286c8189227c90ad07ebbe1bdddd2f7e7e47a187da35966529f7adb689089\": rpc error: code = NotFound desc = could not find container \"244286c8189227c90ad07ebbe1bdddd2f7e7e47a187da35966529f7adb689089\": container with ID starting with 244286c8189227c90ad07ebbe1bdddd2f7e7e47a187da35966529f7adb689089 not found: ID does not exist"
Oct 30 22:31:51.890119 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.890076    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"]
Oct 30 22:31:51.896124 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.896095    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w5-b7588a-6d68b9999f-9s89l"]
Oct 30 22:31:51.933694 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:51.933626    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:52.018184 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:52.018154    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"]
Oct 30 22:31:52.023604 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:52.023569    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w5-b7588a-856fb9648c-h8krx"]
Oct 30 22:31:53.381900 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:53.381871    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="17a688d6-2e79-4018-9c79-fc505a28f9c6" path="/var/lib/kubelet/pods/17a688d6-2e79-4018-9c79-fc505a28f9c6/volumes"
Oct 30 22:31:53.382305 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:53.382291    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d647ad9-c005-4e6b-8451-83e8789c0bc8" path="/var/lib/kubelet/pods/9d647ad9-c005-4e6b-8451-83e8789c0bc8/volumes"
Oct 30 22:31:56.336986 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:56.336931    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns" podUID="f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b" containerName="payload-pre-processing" containerID="cri-o://973c0e27d9fd4d351076b00aeeffcb6a4727fbd70bef9b6ce61601977f9fcb8b" gracePeriod=25
Oct 30 22:31:57.139242 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:57.139208    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:58.279037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.279004    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main" containerID="cri-o://040a5d30a08b6f39b2e4e651e6391010e29adb387ef31fee84dd2fb53244bc74" gracePeriod=45
Oct 30 22:31:58.328188 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.328154    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main" containerID="cri-o://5ebb0760f863cb8fc940abb4da98a5a3154d6795867a575a857cd76771ac1ec5" gracePeriod=45
Oct 30 22:31:58.332153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.332123    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main" containerID="cri-o://1553de21b422482888701c6338cc1c6411ff2f2864042d114199b71b7b20522b" gracePeriod=45
Oct 30 22:31:58.629697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.627803    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:31:58.657911 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.657879    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-home\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-home\") pod \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") "
Oct 30 22:31:58.658055 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.657928    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-tmp-dir\") pod \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") "
Oct 30 22:31:58.658055 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.657957    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-dshm\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-dshm\") pod \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") "
Oct 30 22:31:58.658055 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.658019    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-kube-api-access-vp25w\" (UniqueName: \"kubernetes.io/projected/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-kube-api-access-vp25w\") pod \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") "
Oct 30 22:31:58.658264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.658054    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-model-cache\") pod \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") "
Oct 30 22:31:58.658264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.658167    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-home" pod "338d3119-5b9d-44eb-bbc3-19f46bd9fe60" (UID: "338d3119-5b9d-44eb-bbc3-19f46bd9fe60"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:58.658375 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.658265    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-tmp-dir" pod "338d3119-5b9d-44eb-bbc3-19f46bd9fe60" (UID: "338d3119-5b9d-44eb-bbc3-19f46bd9fe60"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:58.658375 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.658283    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-tls-certs\" (UniqueName: \"kubernetes.io/secret/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-tls-certs\") pod \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\" (UID: \"338d3119-5b9d-44eb-bbc3-19f46bd9fe60\") "
Oct 30 22:31:58.658480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.658383    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-model-cache" pod "338d3119-5b9d-44eb-bbc3-19f46bd9fe60" (UID: "338d3119-5b9d-44eb-bbc3-19f46bd9fe60"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:58.658965 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.658941    5258 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-home\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.659064 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.658969    5258 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-tmp-dir\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.659064 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.658984    5258 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-model-cache\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.660788 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.660758    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-kube-api-access-vp25w" pod "338d3119-5b9d-44eb-bbc3-19f46bd9fe60" (UID: "338d3119-5b9d-44eb-bbc3-19f46bd9fe60"). InnerVolumeSpecName "kube-api-access-vp25w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:58.660936 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.660915    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-tls-certs" pod "338d3119-5b9d-44eb-bbc3-19f46bd9fe60" (UID: "338d3119-5b9d-44eb-bbc3-19f46bd9fe60"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:31:58.661104 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.661082    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-dshm" pod "338d3119-5b9d-44eb-bbc3-19f46bd9fe60" (UID: "338d3119-5b9d-44eb-bbc3-19f46bd9fe60"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:58.682050 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.682006    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:31:58.684828 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.684802    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:31:58.759619 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.759551    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-tmp-dir\") pod \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") "
Oct 30 22:31:58.759812 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.759646    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-dshm\") pod \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") "
Oct 30 22:31:58.759812 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.759690    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-model-cache\") pod \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") "
Oct 30 22:31:58.759812 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.759763    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e518f67a-3d86-4c6f-8940-9da1d76ac85e-kube-api-access-rsphx\" (UniqueName: \"kubernetes.io/projected/e518f67a-3d86-4c6f-8940-9da1d76ac85e-kube-api-access-rsphx\") pod \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") "
Oct 30 22:31:58.759812 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.759795    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-home\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-home\") pod \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") "
Oct 30 22:31:58.760049 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.759842    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1df49718-8a53-4773-a510-555ee7c50f27-tls-certs\" (UniqueName: \"kubernetes.io/secret/1df49718-8a53-4773-a510-555ee7c50f27-tls-certs\") pod \"1df49718-8a53-4773-a510-555ee7c50f27\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") "
Oct 30 22:31:58.760049 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.759886    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-tmp-dir" pod "e518f67a-3d86-4c6f-8940-9da1d76ac85e" (UID: "e518f67a-3d86-4c6f-8940-9da1d76ac85e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:58.760049 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.759913    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1df49718-8a53-4773-a510-555ee7c50f27-kube-api-access-hz94t\" (UniqueName: \"kubernetes.io/projected/1df49718-8a53-4773-a510-555ee7c50f27-kube-api-access-hz94t\") pod \"1df49718-8a53-4773-a510-555ee7c50f27\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") "
Oct 30 22:31:58.760049 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.759965    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e518f67a-3d86-4c6f-8940-9da1d76ac85e-tls-certs\" (UniqueName: \"kubernetes.io/secret/e518f67a-3d86-4c6f-8940-9da1d76ac85e-tls-certs\") pod \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\" (UID: \"e518f67a-3d86-4c6f-8940-9da1d76ac85e\") "
Oct 30 22:31:58.760049 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.760000    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-model-cache\") pod \"1df49718-8a53-4773-a510-555ee7c50f27\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") "
Oct 30 22:31:58.760363 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.760062    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-dshm\") pod \"1df49718-8a53-4773-a510-555ee7c50f27\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") "
Oct 30 22:31:58.760363 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.760089    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-home\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-home\") pod \"1df49718-8a53-4773-a510-555ee7c50f27\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") "
Oct 30 22:31:58.760363 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.760100    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-home" pod "e518f67a-3d86-4c6f-8940-9da1d76ac85e" (UID: "e518f67a-3d86-4c6f-8940-9da1d76ac85e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:58.760363 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.760146    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-tmp-dir\") pod \"1df49718-8a53-4773-a510-555ee7c50f27\" (UID: \"1df49718-8a53-4773-a510-555ee7c50f27\") "
Oct 30 22:31:58.760564 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.760495    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-model-cache" pod "1df49718-8a53-4773-a510-555ee7c50f27" (UID: "1df49718-8a53-4773-a510-555ee7c50f27"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:58.760723 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.760700    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp25w\" (UniqueName: \"kubernetes.io/projected/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-kube-api-access-vp25w\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.760879 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.760854    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-home" pod "1df49718-8a53-4773-a510-555ee7c50f27" (UID: "1df49718-8a53-4773-a510-555ee7c50f27"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:58.760977 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.760962    5258 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-model-cache\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.761067 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.761052    5258 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-tls-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.761152 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.761142    5258 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-tmp-dir\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.761241 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.761220    5258 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-home\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.761241 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.761241    5258 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338d3119-5b9d-44eb-bbc3-19f46bd9fe60-dshm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.761418 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.761059    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-model-cache" pod "e518f67a-3d86-4c6f-8940-9da1d76ac85e" (UID: "e518f67a-3d86-4c6f-8940-9da1d76ac85e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:58.761418 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.761301    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-tmp-dir" pod "1df49718-8a53-4773-a510-555ee7c50f27" (UID: "1df49718-8a53-4773-a510-555ee7c50f27"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:58.763282 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.763255    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-dshm" pod "1df49718-8a53-4773-a510-555ee7c50f27" (UID: "1df49718-8a53-4773-a510-555ee7c50f27"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:58.766962 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.766936    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1df49718-8a53-4773-a510-555ee7c50f27-tls-certs" pod "1df49718-8a53-4773-a510-555ee7c50f27" (UID: "1df49718-8a53-4773-a510-555ee7c50f27"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:31:58.767068 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.766937    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e518f67a-3d86-4c6f-8940-9da1d76ac85e-kube-api-access-rsphx" pod "e518f67a-3d86-4c6f-8940-9da1d76ac85e" (UID: "e518f67a-3d86-4c6f-8940-9da1d76ac85e"). InnerVolumeSpecName "kube-api-access-rsphx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:58.767068 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.767055    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1df49718-8a53-4773-a510-555ee7c50f27-kube-api-access-hz94t" pod "1df49718-8a53-4773-a510-555ee7c50f27" (UID: "1df49718-8a53-4773-a510-555ee7c50f27"). InnerVolumeSpecName "kube-api-access-hz94t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:31:58.767162 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.767064    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-dshm" pod "e518f67a-3d86-4c6f-8940-9da1d76ac85e" (UID: "e518f67a-3d86-4c6f-8940-9da1d76ac85e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:31:58.768360 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.768332    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e518f67a-3d86-4c6f-8940-9da1d76ac85e-tls-certs" pod "e518f67a-3d86-4c6f-8940-9da1d76ac85e" (UID: "e518f67a-3d86-4c6f-8940-9da1d76ac85e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:31:58.815187 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.815160    5258 generic.go:356] "Generic (PLEG): container finished" podID="1df49718-8a53-4773-a510-555ee7c50f27" containerID="1553de21b422482888701c6338cc1c6411ff2f2864042d114199b71b7b20522b" exitCode=0
Oct 30 22:31:58.815344 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.815199    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"
Oct 30 22:31:58.815344 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.815243    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" event={"ID":"1df49718-8a53-4773-a510-555ee7c50f27","Type":"ContainerDied","Data":"1553de21b422482888701c6338cc1c6411ff2f2864042d114199b71b7b20522b"}
Oct 30 22:31:58.815344 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.815289    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p" event={"ID":"1df49718-8a53-4773-a510-555ee7c50f27","Type":"ContainerDied","Data":"9d3eb8e69ab6ee52674bf6da4f80c2e3fd4f0a46fda5cb9b1bd321abfbe044e2"}
Oct 30 22:31:58.815344 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.815310    5258 scope.go:122] "RemoveContainer" containerID="1553de21b422482888701c6338cc1c6411ff2f2864042d114199b71b7b20522b"
Oct 30 22:31:58.816868 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.816845    5258 generic.go:356] "Generic (PLEG): container finished" podID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerID="040a5d30a08b6f39b2e4e651e6391010e29adb387ef31fee84dd2fb53244bc74" exitCode=0
Oct 30 22:31:58.816968 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.816882    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"
Oct 30 22:31:58.816968 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.816940    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" event={"ID":"338d3119-5b9d-44eb-bbc3-19f46bd9fe60","Type":"ContainerDied","Data":"040a5d30a08b6f39b2e4e651e6391010e29adb387ef31fee84dd2fb53244bc74"}
Oct 30 22:31:58.817078 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.816984    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n" event={"ID":"338d3119-5b9d-44eb-bbc3-19f46bd9fe60","Type":"ContainerDied","Data":"34d8dc743e79dc6f871f271de6da5cf932d6f80dcad67ccca576cac970c02149"}
Oct 30 22:31:58.818710 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.818668    5258 generic.go:356] "Generic (PLEG): container finished" podID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerID="5ebb0760f863cb8fc940abb4da98a5a3154d6795867a575a857cd76771ac1ec5" exitCode=0
Oct 30 22:31:58.818823 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.818710    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" event={"ID":"e518f67a-3d86-4c6f-8940-9da1d76ac85e","Type":"ContainerDied","Data":"5ebb0760f863cb8fc940abb4da98a5a3154d6795867a575a857cd76771ac1ec5"}
Oct 30 22:31:58.818823 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.818731    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"
Oct 30 22:31:58.818823 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.818750    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4" event={"ID":"e518f67a-3d86-4c6f-8940-9da1d76ac85e","Type":"ContainerDied","Data":"1ec72fd3e5540516f236165a96f6042615288bab7faa6e367dd1333bf2f5f622"}
Oct 30 22:31:58.826910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.826893    5258 scope.go:122] "RemoveContainer" containerID="1553de21b422482888701c6338cc1c6411ff2f2864042d114199b71b7b20522b"
Oct 30 22:31:58.827184 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:58.827161    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1553de21b422482888701c6338cc1c6411ff2f2864042d114199b71b7b20522b\": container with ID starting with 1553de21b422482888701c6338cc1c6411ff2f2864042d114199b71b7b20522b not found: ID does not exist" containerID="1553de21b422482888701c6338cc1c6411ff2f2864042d114199b71b7b20522b"
Oct 30 22:31:58.827386 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.827190    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1553de21b422482888701c6338cc1c6411ff2f2864042d114199b71b7b20522b"} err="failed to get container status \"1553de21b422482888701c6338cc1c6411ff2f2864042d114199b71b7b20522b\": rpc error: code = NotFound desc = could not find container \"1553de21b422482888701c6338cc1c6411ff2f2864042d114199b71b7b20522b\": container with ID starting with 1553de21b422482888701c6338cc1c6411ff2f2864042d114199b71b7b20522b not found: ID does not exist"
Oct 30 22:31:58.827386 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.827208    5258 scope.go:122] "RemoveContainer" containerID="040a5d30a08b6f39b2e4e651e6391010e29adb387ef31fee84dd2fb53244bc74"
Oct 30 22:31:58.837291 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.837273    5258 scope.go:122] "RemoveContainer" containerID="040a5d30a08b6f39b2e4e651e6391010e29adb387ef31fee84dd2fb53244bc74"
Oct 30 22:31:58.837525 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:58.837506    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"040a5d30a08b6f39b2e4e651e6391010e29adb387ef31fee84dd2fb53244bc74\": container with ID starting with 040a5d30a08b6f39b2e4e651e6391010e29adb387ef31fee84dd2fb53244bc74 not found: ID does not exist" containerID="040a5d30a08b6f39b2e4e651e6391010e29adb387ef31fee84dd2fb53244bc74"
Oct 30 22:31:58.837609 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.837531    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"040a5d30a08b6f39b2e4e651e6391010e29adb387ef31fee84dd2fb53244bc74"} err="failed to get container status \"040a5d30a08b6f39b2e4e651e6391010e29adb387ef31fee84dd2fb53244bc74\": rpc error: code = NotFound desc = could not find container \"040a5d30a08b6f39b2e4e651e6391010e29adb387ef31fee84dd2fb53244bc74\": container with ID starting with 040a5d30a08b6f39b2e4e651e6391010e29adb387ef31fee84dd2fb53244bc74 not found: ID does not exist"
Oct 30 22:31:58.837609 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.837557    5258 scope.go:122] "RemoveContainer" containerID="5ebb0760f863cb8fc940abb4da98a5a3154d6795867a575a857cd76771ac1ec5"
Oct 30 22:31:58.846171 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.846147    5258 scope.go:122] "RemoveContainer" containerID="5ebb0760f863cb8fc940abb4da98a5a3154d6795867a575a857cd76771ac1ec5"
Oct 30 22:31:58.846394 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:31:58.846373    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ebb0760f863cb8fc940abb4da98a5a3154d6795867a575a857cd76771ac1ec5\": container with ID starting with 5ebb0760f863cb8fc940abb4da98a5a3154d6795867a575a857cd76771ac1ec5 not found: ID does not exist" containerID="5ebb0760f863cb8fc940abb4da98a5a3154d6795867a575a857cd76771ac1ec5"
Oct 30 22:31:58.846440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.846400    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ebb0760f863cb8fc940abb4da98a5a3154d6795867a575a857cd76771ac1ec5"} err="failed to get container status \"5ebb0760f863cb8fc940abb4da98a5a3154d6795867a575a857cd76771ac1ec5\": rpc error: code = NotFound desc = could not find container \"5ebb0760f863cb8fc940abb4da98a5a3154d6795867a575a857cd76771ac1ec5\": container with ID starting with 5ebb0760f863cb8fc940abb4da98a5a3154d6795867a575a857cd76771ac1ec5 not found: ID does not exist"
Oct 30 22:31:58.862701 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.862676    5258 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1df49718-8a53-4773-a510-555ee7c50f27-tls-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.862701 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.862701    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz94t\" (UniqueName: \"kubernetes.io/projected/1df49718-8a53-4773-a510-555ee7c50f27-kube-api-access-hz94t\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.862863 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.862713    5258 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e518f67a-3d86-4c6f-8940-9da1d76ac85e-tls-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.862863 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.862722    5258 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-dshm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.862863 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.862733    5258 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-home\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.862863 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.862741    5258 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1df49718-8a53-4773-a510-555ee7c50f27-tmp-dir\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.862863 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.862749    5258 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-dshm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.862863 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.862758    5258 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e518f67a-3d86-4c6f-8940-9da1d76ac85e-model-cache\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:58.862863 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:58.862766    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsphx\" (UniqueName: \"kubernetes.io/projected/e518f67a-3d86-4c6f-8940-9da1d76ac85e-kube-api-access-rsphx\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:31:59.105455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:59.105379    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"]
Oct 30 22:31:59.110380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:59.110352    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/premium-w1-77cb1f-kserve-745d4f4465-pg2j4"]
Oct 30 22:31:59.220614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:59.220564    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"]
Oct 30 22:31:59.226476 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:59.226453    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/simulator-w1-77cb1f-kserve-7d98f7677b-2nv7p"]
Oct 30 22:31:59.343577 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:59.341917    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"]
Oct 30 22:31:59.350924 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:59.350899    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-77cb1f/distinct-2-w1-77cb1f-kserve-5dfd68f5c5-d4v8n"]
Oct 30 22:31:59.380822 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:59.380763    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1df49718-8a53-4773-a510-555ee7c50f27" path="/var/lib/kubelet/pods/1df49718-8a53-4773-a510-555ee7c50f27/volumes"
Oct 30 22:31:59.381197 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:59.381183    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" path="/var/lib/kubelet/pods/338d3119-5b9d-44eb-bbc3-19f46bd9fe60/volumes"
Oct 30 22:31:59.381578 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:31:59.381565    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" path="/var/lib/kubelet/pods/e518f67a-3d86-4c6f-8940-9da1d76ac85e/volumes"
Oct 30 22:32:01.339408 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:01.339363    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns" podUID="f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:32:02.324761 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:02.324722    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:07.382921 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:07.382885    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:11.339450 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:11.339409    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns" podUID="f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:32:11.582765 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:11.582729    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"]
Oct 30 22:32:11.582976 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:11.582940    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6" podUID="3074c0ce-7879-4cf7-a334-5ea20dcffd01" containerName="maas-api" containerID="cri-o://059938af98429efbbd5dd2c5416ca6ad5e4ed186491856f61ca636ebdcd806cc" gracePeriod=30
Oct 30 22:32:11.749584 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:11.749539    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:11.879356 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:11.879324    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:32:11.914251 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:11.914220    5258 generic.go:356] "Generic (PLEG): container finished" podID="3074c0ce-7879-4cf7-a334-5ea20dcffd01" containerID="059938af98429efbbd5dd2c5416ca6ad5e4ed186491856f61ca636ebdcd806cc" exitCode=0
Oct 30 22:32:11.914366 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:11.914265    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"
Oct 30 22:32:11.914366 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:11.914298    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6" event={"ID":"3074c0ce-7879-4cf7-a334-5ea20dcffd01","Type":"ContainerDied","Data":"059938af98429efbbd5dd2c5416ca6ad5e4ed186491856f61ca636ebdcd806cc"}
Oct 30 22:32:11.914366 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:11.914351    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6" event={"ID":"3074c0ce-7879-4cf7-a334-5ea20dcffd01","Type":"ContainerDied","Data":"56226fb33999135a105533968a43a55d222dff3945a97d5718c0ce705a2bcd90"}
Oct 30 22:32:11.914489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:11.914374    5258 scope.go:122] "RemoveContainer" containerID="059938af98429efbbd5dd2c5416ca6ad5e4ed186491856f61ca636ebdcd806cc"
Oct 30 22:32:11.926014 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:11.925992    5258 scope.go:122] "RemoveContainer" containerID="059938af98429efbbd5dd2c5416ca6ad5e4ed186491856f61ca636ebdcd806cc"
Oct 30 22:32:11.926311 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:32:11.926289    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"059938af98429efbbd5dd2c5416ca6ad5e4ed186491856f61ca636ebdcd806cc\": container with ID starting with 059938af98429efbbd5dd2c5416ca6ad5e4ed186491856f61ca636ebdcd806cc not found: ID does not exist" containerID="059938af98429efbbd5dd2c5416ca6ad5e4ed186491856f61ca636ebdcd806cc"
Oct 30 22:32:11.926361 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:11.926319    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"059938af98429efbbd5dd2c5416ca6ad5e4ed186491856f61ca636ebdcd806cc"} err="failed to get container status \"059938af98429efbbd5dd2c5416ca6ad5e4ed186491856f61ca636ebdcd806cc\": rpc error: code = NotFound desc = could not find container \"059938af98429efbbd5dd2c5416ca6ad5e4ed186491856f61ca636ebdcd806cc\": container with ID starting with 059938af98429efbbd5dd2c5416ca6ad5e4ed186491856f61ca636ebdcd806cc not found: ID does not exist"
Oct 30 22:32:12.021443 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:12.021404    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-metrics-certs\") pod \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") "
Oct 30 22:32:12.021678 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:12.021566    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3074c0ce-7879-4cf7-a334-5ea20dcffd01-kube-api-access-c5p5w\" (UniqueName: \"kubernetes.io/projected/3074c0ce-7879-4cf7-a334-5ea20dcffd01-kube-api-access-c5p5w\") pod \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") "
Oct 30 22:32:12.021757 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:12.021737    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-maas-api-tls\") pod \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") "
Oct 30 22:32:12.022124 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:12.022090    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3074c0ce-7879-4cf7-a334-5ea20dcffd01-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3074c0ce-7879-4cf7-a334-5ea20dcffd01-openshift-service-ca\") pod \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\" (UID: \"3074c0ce-7879-4cf7-a334-5ea20dcffd01\") "
Oct 30 22:32:12.022220 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:12.022203    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3074c0ce-7879-4cf7-a334-5ea20dcffd01-openshift-service-ca" pod "3074c0ce-7879-4cf7-a334-5ea20dcffd01" (UID: "3074c0ce-7879-4cf7-a334-5ea20dcffd01"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:32:12.022564 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:12.022544    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3074c0ce-7879-4cf7-a334-5ea20dcffd01-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:12.027618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:12.027250    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3074c0ce-7879-4cf7-a334-5ea20dcffd01-kube-api-access-c5p5w" pod "3074c0ce-7879-4cf7-a334-5ea20dcffd01" (UID: "3074c0ce-7879-4cf7-a334-5ea20dcffd01"). InnerVolumeSpecName "kube-api-access-c5p5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:32:12.027618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:12.027288    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-metrics-certs" pod "3074c0ce-7879-4cf7-a334-5ea20dcffd01" (UID: "3074c0ce-7879-4cf7-a334-5ea20dcffd01"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:32:12.029014 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:12.028989    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-maas-api-tls" pod "3074c0ce-7879-4cf7-a334-5ea20dcffd01" (UID: "3074c0ce-7879-4cf7-a334-5ea20dcffd01"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:32:12.124475 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:12.124360    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:12.124475 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:12.124398    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3074c0ce-7879-4cf7-a334-5ea20dcffd01-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:12.124475 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:12.124414    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5p5w\" (UniqueName: \"kubernetes.io/projected/3074c0ce-7879-4cf7-a334-5ea20dcffd01-kube-api-access-c5p5w\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:12.338709 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:12.338673    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"]
Oct 30 22:32:12.344756 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:12.344729    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-7fd7ba-558948cbdd-kpxm6"]
Oct 30 22:32:13.161474 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:32:13.161436    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:32:13.350504 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:13.350467    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:13.381128 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:13.381102    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3074c0ce-7879-4cf7-a334-5ea20dcffd01" path="/var/lib/kubelet/pods/3074c0ce-7879-4cf7-a334-5ea20dcffd01/volumes"
Oct 30 22:32:13.579982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:13.579953    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:13.826781 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:13.826743    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:14.372252 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:14.372215    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:16.503992 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:16.503964    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"
Oct 30 22:32:16.600935 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:16.600856    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b-kube-api-access-d6ptl\" (UniqueName: \"kubernetes.io/projected/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b-kube-api-access-d6ptl\") pod \"f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b\" (UID: \"f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b\") "
Oct 30 22:32:16.601085 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:16.600948    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b-plugins-config-volume\") pod \"f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b\" (UID: \"f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b\") "
Oct 30 22:32:16.601346 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:16.601306    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b-plugins-config-volume" pod "f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b" (UID: "f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:32:16.601528 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:16.601511    5258 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b-plugins-config-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:16.603111 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:16.603083    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b-kube-api-access-d6ptl" pod "f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b" (UID: "f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b"). InnerVolumeSpecName "kube-api-access-d6ptl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:32:16.703200 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:16.703163    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6ptl\" (UniqueName: \"kubernetes.io/projected/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b-kube-api-access-d6ptl\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:16.950879 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:16.950801    5258 generic.go:356] "Generic (PLEG): container finished" podID="f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b" containerID="973c0e27d9fd4d351076b00aeeffcb6a4727fbd70bef9b6ce61601977f9fcb8b" exitCode=0
Oct 30 22:32:16.950879 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:16.950844    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"
Oct 30 22:32:16.951051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:16.950884    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns" event={"ID":"f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b","Type":"ContainerDied","Data":"973c0e27d9fd4d351076b00aeeffcb6a4727fbd70bef9b6ce61601977f9fcb8b"}
Oct 30 22:32:16.951051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:16.950940    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns" event={"ID":"f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b","Type":"ContainerDied","Data":"5fbf0089d5b92bbda6f38d66a6ff25c66fcc749874807bb3c8f1f8cb2d0a4495"}
Oct 30 22:32:16.951051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:16.950967    5258 scope.go:122] "RemoveContainer" containerID="973c0e27d9fd4d351076b00aeeffcb6a4727fbd70bef9b6ce61601977f9fcb8b"
Oct 30 22:32:16.961637 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:16.961624    5258 scope.go:122] "RemoveContainer" containerID="973c0e27d9fd4d351076b00aeeffcb6a4727fbd70bef9b6ce61601977f9fcb8b"
Oct 30 22:32:16.961900 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:32:16.961881    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"973c0e27d9fd4d351076b00aeeffcb6a4727fbd70bef9b6ce61601977f9fcb8b\": container with ID starting with 973c0e27d9fd4d351076b00aeeffcb6a4727fbd70bef9b6ce61601977f9fcb8b not found: ID does not exist" containerID="973c0e27d9fd4d351076b00aeeffcb6a4727fbd70bef9b6ce61601977f9fcb8b"
Oct 30 22:32:16.961953 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:16.961910    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"973c0e27d9fd4d351076b00aeeffcb6a4727fbd70bef9b6ce61601977f9fcb8b"} err="failed to get container status \"973c0e27d9fd4d351076b00aeeffcb6a4727fbd70bef9b6ce61601977f9fcb8b\": rpc error: code = NotFound desc = could not find container \"973c0e27d9fd4d351076b00aeeffcb6a4727fbd70bef9b6ce61601977f9fcb8b\": container with ID starting with 973c0e27d9fd4d351076b00aeeffcb6a4727fbd70bef9b6ce61601977f9fcb8b not found: ID does not exist"
Oct 30 22:32:17.119578 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:17.119547    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"]
Oct 30 22:32:17.168981 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:17.168953    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-77cb1f-5fd6bd47cf-s87ns"]
Oct 30 22:32:17.382558 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:17.382528    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b" path="/var/lib/kubelet/pods/f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b/volumes"
Oct 30 22:32:18.547101 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547066    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"]
Oct 30 22:32:18.547622 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547607    5258 cpu_manager.go:414] "containerMap: removing container" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main"
Oct 30 22:32:18.547622 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547622    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main"
Oct 30 22:32:18.547711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547633    5258 cpu_manager.go:414] "containerMap: removing container" podUID="bdc948e1-3516-469d-a39f-8531663ea68c" containerName="istio-proxy"
Oct 30 22:32:18.547711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547639    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bdc948e1-3516-469d-a39f-8531663ea68c" containerName="istio-proxy"
Oct 30 22:32:18.547711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547652    5258 cpu_manager.go:414] "containerMap: removing container" podUID="74842bd9-f833-4cc2-b4e9-139741fac7ff" containerName="revoke-keys"
Oct 30 22:32:18.547711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547657    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74842bd9-f833-4cc2-b4e9-139741fac7ff" containerName="revoke-keys"
Oct 30 22:32:18.547711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547668    5258 cpu_manager.go:414] "containerMap: removing container" podUID="8e656e61-b054-463d-be01-3f1fa44ebfe1" containerName="maas-api"
Oct 30 22:32:18.547711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547672    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e656e61-b054-463d-be01-3f1fa44ebfe1" containerName="maas-api"
Oct 30 22:32:18.547711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547680    5258 cpu_manager.go:414] "containerMap: removing container" podUID="bdc948e1-3516-469d-a39f-8531663ea68c" containerName="istio-proxy"
Oct 30 22:32:18.547711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547685    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bdc948e1-3516-469d-a39f-8531663ea68c" containerName="istio-proxy"
Oct 30 22:32:18.547711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547692    5258 cpu_manager.go:414] "containerMap: removing container" podUID="9d647ad9-c005-4e6b-8451-83e8789c0bc8" containerName="payload-pre-processing"
Oct 30 22:32:18.547711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547697    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d647ad9-c005-4e6b-8451-83e8789c0bc8" containerName="payload-pre-processing"
Oct 30 22:32:18.547711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547710    5258 cpu_manager.go:414] "containerMap: removing container" podUID="b7a7449a-31c0-4974-b474-914075734486" containerName="maas-api"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547719    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7a7449a-31c0-4974-b474-914075734486" containerName="maas-api"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547730    5258 cpu_manager.go:414] "containerMap: removing container" podUID="1e670da5-3e9a-4d99-a5e6-d1251d5efcc7" containerName="payload-pre-processing"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547735    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e670da5-3e9a-4d99-a5e6-d1251d5efcc7" containerName="payload-pre-processing"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547745    5258 cpu_manager.go:414] "containerMap: removing container" podUID="3074c0ce-7879-4cf7-a334-5ea20dcffd01" containerName="maas-api"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547749    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3074c0ce-7879-4cf7-a334-5ea20dcffd01" containerName="maas-api"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547755    5258 cpu_manager.go:414] "containerMap: removing container" podUID="e05348d0-23b5-49d1-8171-17f2ccbcd41a" containerName="cleanup"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547760    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e05348d0-23b5-49d1-8171-17f2ccbcd41a" containerName="cleanup"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547774    5258 cpu_manager.go:414] "containerMap: removing container" podUID="57597cec-7e08-426c-ba3b-bda0d762f67e" containerName="maas-api"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547782    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="57597cec-7e08-426c-ba3b-bda0d762f67e" containerName="maas-api"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547792    5258 cpu_manager.go:414] "containerMap: removing container" podUID="e05348d0-23b5-49d1-8171-17f2ccbcd41a" containerName="cleanup"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547796    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e05348d0-23b5-49d1-8171-17f2ccbcd41a" containerName="cleanup"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547802    5258 cpu_manager.go:414] "containerMap: removing container" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547806    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547812    5258 cpu_manager.go:414] "containerMap: removing container" podUID="e05348d0-23b5-49d1-8171-17f2ccbcd41a" containerName="cleanup"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547816    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e05348d0-23b5-49d1-8171-17f2ccbcd41a" containerName="cleanup"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547823    5258 cpu_manager.go:414] "containerMap: removing container" podUID="f3d87229-3602-4837-bc3c-a51ddf3c4cf5" containerName="istio-proxy"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547828    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f3d87229-3602-4837-bc3c-a51ddf3c4cf5" containerName="istio-proxy"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547834    5258 cpu_manager.go:414] "containerMap: removing container" podUID="769ff87d-8eca-48b8-ae57-27d2347ba07d" containerName="cleanup"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547838    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="769ff87d-8eca-48b8-ae57-27d2347ba07d" containerName="cleanup"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547849    5258 cpu_manager.go:414] "containerMap: removing container" podUID="3dd9adb3-a2d7-4f2b-8985-d043bf78cecc" containerName="payload-processing"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547853    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3dd9adb3-a2d7-4f2b-8985-d043bf78cecc" containerName="payload-processing"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547862    5258 cpu_manager.go:414] "containerMap: removing container" podUID="285e9bb2-0d1c-48c4-a48d-48d2f3b2aace" containerName="maas-api"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547867    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="285e9bb2-0d1c-48c4-a48d-48d2f3b2aace" containerName="maas-api"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547874    5258 cpu_manager.go:414] "containerMap: removing container" podUID="769ff87d-8eca-48b8-ae57-27d2347ba07d" containerName="cleanup"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547878    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="769ff87d-8eca-48b8-ae57-27d2347ba07d" containerName="cleanup"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547885    5258 cpu_manager.go:414] "containerMap: removing container" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547889    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547896    5258 cpu_manager.go:414] "containerMap: removing container" podUID="878e5b5e-2d16-4105-9646-98904fcce19c" containerName="istio-proxy"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547901    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="878e5b5e-2d16-4105-9646-98904fcce19c" containerName="istio-proxy"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547908    5258 cpu_manager.go:414] "containerMap: removing container" podUID="17a688d6-2e79-4018-9c79-fc505a28f9c6" containerName="payload-processing"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547913    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="17a688d6-2e79-4018-9c79-fc505a28f9c6" containerName="payload-processing"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547921    5258 cpu_manager.go:414] "containerMap: removing container" podUID="878e5b5e-2d16-4105-9646-98904fcce19c" containerName="istio-proxy"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547925    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="878e5b5e-2d16-4105-9646-98904fcce19c" containerName="istio-proxy"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547932    5258 cpu_manager.go:414] "containerMap: removing container" podUID="f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b" containerName="payload-pre-processing"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547936    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b" containerName="payload-pre-processing"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547949    5258 cpu_manager.go:414] "containerMap: removing container" podUID="f9cf2d59-e154-45ce-864e-675a1251feee" containerName="maas-api"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.547956    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9cf2d59-e154-45ce-864e-675a1251feee" containerName="maas-api"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548062    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="74842bd9-f833-4cc2-b4e9-139741fac7ff" containerName="revoke-keys"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548073    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e656e61-b054-463d-be01-3f1fa44ebfe1" containerName="maas-api"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548084    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="bdc948e1-3516-469d-a39f-8531663ea68c" containerName="istio-proxy"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548094    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d647ad9-c005-4e6b-8451-83e8789c0bc8" containerName="payload-pre-processing"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548102    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="b7a7449a-31c0-4974-b474-914075734486" containerName="maas-api"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548109    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e670da5-3e9a-4d99-a5e6-d1251d5efcc7" containerName="payload-pre-processing"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548116    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="3074c0ce-7879-4cf7-a334-5ea20dcffd01" containerName="maas-api"
Oct 30 22:32:18.548096 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548122    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="e05348d0-23b5-49d1-8171-17f2ccbcd41a" containerName="cleanup"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548128    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="57597cec-7e08-426c-ba3b-bda0d762f67e" containerName="maas-api"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548134    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="e05348d0-23b5-49d1-8171-17f2ccbcd41a" containerName="cleanup"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548140    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="1df49718-8a53-4773-a510-555ee7c50f27" containerName="main"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548146    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="f3d87229-3602-4837-bc3c-a51ddf3c4cf5" containerName="istio-proxy"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548152    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="769ff87d-8eca-48b8-ae57-27d2347ba07d" containerName="cleanup"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548158    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="3dd9adb3-a2d7-4f2b-8985-d043bf78cecc" containerName="payload-processing"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548164    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="285e9bb2-0d1c-48c4-a48d-48d2f3b2aace" containerName="maas-api"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548169    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="769ff87d-8eca-48b8-ae57-27d2347ba07d" containerName="cleanup"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548176    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="769ff87d-8eca-48b8-ae57-27d2347ba07d" containerName="cleanup"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548182    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="e518f67a-3d86-4c6f-8940-9da1d76ac85e" containerName="main"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548187    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="878e5b5e-2d16-4105-9646-98904fcce19c" containerName="istio-proxy"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548192    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="17a688d6-2e79-4018-9c79-fc505a28f9c6" containerName="payload-processing"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548197    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="878e5b5e-2d16-4105-9646-98904fcce19c" containerName="istio-proxy"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548203    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7a5fdf5-c6fe-4bc9-9f02-8c10928e1b6b" containerName="payload-pre-processing"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548208    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="f9cf2d59-e154-45ce-864e-675a1251feee" containerName="maas-api"
Oct 30 22:32:18.549471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.548215    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="338d3119-5b9d-44eb-bbc3-19f46bd9fe60" containerName="main"
Oct 30 22:32:18.552897 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.552876    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:18.624819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.624784    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-openshift-service-ca\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:18.625031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.624913    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fvcb\" (UniqueName: \"kubernetes.io/projected/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-kube-api-access-8fvcb\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:18.625031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.624979    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-metrics-certs\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:18.625182 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.625120    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-maas-api-tls\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:18.658056 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.658029    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-18515933-serving-cert\""
Oct 30 22:32:18.663513 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.663484    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"]
Oct 30 22:32:18.726071 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.726038    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fvcb\" (UniqueName: \"kubernetes.io/projected/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-kube-api-access-8fvcb\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:18.726278 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.726125    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-metrics-certs\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:18.726278 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.726247    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-maas-api-tls\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:18.726399 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.726313    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-openshift-service-ca\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:18.726399 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:32:18.726381    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-18515933-serving-cert: secret "maas-api-e2e-mt-18515933-serving-cert" not found
Oct 30 22:32:18.726484 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:32:18.726444    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-maas-api-tls podName:abcf45e3-22ba-45f2-b9cc-d80f8ac763cd nodeName:}" failed. No retries permitted until 2026-10-30 22:32:19.226427788 +0000 UTC m=+2253.957284908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-maas-api-tls") pod "maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf" (UID: "abcf45e3-22ba-45f2-b9cc-d80f8ac763cd") : secret "maas-api-e2e-mt-18515933-serving-cert" not found
Oct 30 22:32:18.726953 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.726930    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-openshift-service-ca\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:18.728513 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.728493    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-metrics-certs\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:18.812866 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.805853    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fvcb\" (UniqueName: \"kubernetes.io/projected/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-kube-api-access-8fvcb\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:18.835450 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:18.835413    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:19.056728 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:19.056690    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:19.230987 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:19.230909    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-maas-api-tls\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:19.233439 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:19.233412    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-maas-api-tls\") pod \"maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:19.353552 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:19.353507    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:19.467745 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:19.467711    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:19.853247 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:19.853221    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"]
Oct 30 22:32:19.853907 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:32:19.853876    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabcf45e3_22ba_45f2_b9cc_d80f8ac763cd.slice/crio-3e3ff78d383d6f52764170fd389bd86b7238ee57e80cc69a5c84134e3132fa95 WatchSource:0}: Error finding container 3e3ff78d383d6f52764170fd389bd86b7238ee57e80cc69a5c84134e3132fa95: Status 404 returned error can't find the container with id 3e3ff78d383d6f52764170fd389bd86b7238ee57e80cc69a5c84134e3132fa95
Oct 30 22:32:19.855451 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:19.855429    5258 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:32:19.975494 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:19.975458    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf" event={"ID":"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd","Type":"ContainerStarted","Data":"3e3ff78d383d6f52764170fd389bd86b7238ee57e80cc69a5c84134e3132fa95"}
Oct 30 22:32:20.986187 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:20.986085    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf" event={"ID":"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd","Type":"ContainerStarted","Data":"53f74513cdab779368b39557f1958d7505b16c60455d02f16ead699be39f28bf"}
Oct 30 22:32:20.986187 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:20.986167    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:21.106448 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:21.106389    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf" podStartSLOduration=2.242017846 podStartE2EDuration="3.106372751s" totalImagesPullingTime="864.354905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:32:21.104971918 +0000 UTC m=+2255.835829062" watchObservedRunningTime="2026-10-30 22:32:21.106372751 +0000 UTC m=+2255.837229896"
Oct 30 22:32:21.533294 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:21.533255    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:21.760706 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:21.760659    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:22.820795 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:22.820759    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:23.061408 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.061372    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:23.265380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.265304    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"]
Oct 30 22:32:23.265570 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.265546    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss" podUID="01bd8649-238e-4741-8291-f634efc5139e" containerName="maas-api" containerID="cri-o://32beb2afd66f353ed4699e3c4b1c5a1af20754b5290632a7a8539de8c8bb5290" gracePeriod=30
Oct 30 22:32:23.326463 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.326423    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:23.564001 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.563977    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:32:23.628682 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.628651    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:23.734769 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.734678    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-maas-api-tls\") pod \"01bd8649-238e-4741-8291-f634efc5139e\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") "
Oct 30 22:32:23.734985 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.734906    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/01bd8649-238e-4741-8291-f634efc5139e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01bd8649-238e-4741-8291-f634efc5139e-openshift-service-ca\") pod \"01bd8649-238e-4741-8291-f634efc5139e\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") "
Oct 30 22:32:23.734985 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.734959    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/01bd8649-238e-4741-8291-f634efc5139e-kube-api-access-zj2x5\" (UniqueName: \"kubernetes.io/projected/01bd8649-238e-4741-8291-f634efc5139e-kube-api-access-zj2x5\") pod \"01bd8649-238e-4741-8291-f634efc5139e\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") "
Oct 30 22:32:23.735119 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.735015    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-metrics-certs\") pod \"01bd8649-238e-4741-8291-f634efc5139e\" (UID: \"01bd8649-238e-4741-8291-f634efc5139e\") "
Oct 30 22:32:23.735538 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.735505    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01bd8649-238e-4741-8291-f634efc5139e-openshift-service-ca" pod "01bd8649-238e-4741-8291-f634efc5139e" (UID: "01bd8649-238e-4741-8291-f634efc5139e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:32:23.738242 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.738203    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01bd8649-238e-4741-8291-f634efc5139e-kube-api-access-zj2x5" pod "01bd8649-238e-4741-8291-f634efc5139e" (UID: "01bd8649-238e-4741-8291-f634efc5139e"). InnerVolumeSpecName "kube-api-access-zj2x5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:32:23.738721 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.738695    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-metrics-certs" pod "01bd8649-238e-4741-8291-f634efc5139e" (UID: "01bd8649-238e-4741-8291-f634efc5139e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:32:23.738891 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.738868    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-maas-api-tls" pod "01bd8649-238e-4741-8291-f634efc5139e" (UID: "01bd8649-238e-4741-8291-f634efc5139e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:32:23.836490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.836449    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01bd8649-238e-4741-8291-f634efc5139e-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:23.836490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.836489    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj2x5\" (UniqueName: \"kubernetes.io/projected/01bd8649-238e-4741-8291-f634efc5139e-kube-api-access-zj2x5\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:23.837086 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.836502    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:23.837086 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:23.836511    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01bd8649-238e-4741-8291-f634efc5139e-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:24.012360 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:24.012325    5258 generic.go:356] "Generic (PLEG): container finished" podID="01bd8649-238e-4741-8291-f634efc5139e" containerID="32beb2afd66f353ed4699e3c4b1c5a1af20754b5290632a7a8539de8c8bb5290" exitCode=0
Oct 30 22:32:24.012531 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:24.012371    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"
Oct 30 22:32:24.012531 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:24.012411    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss" event={"ID":"01bd8649-238e-4741-8291-f634efc5139e","Type":"ContainerDied","Data":"32beb2afd66f353ed4699e3c4b1c5a1af20754b5290632a7a8539de8c8bb5290"}
Oct 30 22:32:24.012531 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:24.012466    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss" event={"ID":"01bd8649-238e-4741-8291-f634efc5139e","Type":"ContainerDied","Data":"8b05c4ea1751c47ce40f7de0d51e16696c73261bb385701f68a1a89d2032beb4"}
Oct 30 22:32:24.012531 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:24.012489    5258 scope.go:122] "RemoveContainer" containerID="32beb2afd66f353ed4699e3c4b1c5a1af20754b5290632a7a8539de8c8bb5290"
Oct 30 22:32:24.025003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:24.024985    5258 scope.go:122] "RemoveContainer" containerID="32beb2afd66f353ed4699e3c4b1c5a1af20754b5290632a7a8539de8c8bb5290"
Oct 30 22:32:24.025291 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:32:24.025269    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32beb2afd66f353ed4699e3c4b1c5a1af20754b5290632a7a8539de8c8bb5290\": container with ID starting with 32beb2afd66f353ed4699e3c4b1c5a1af20754b5290632a7a8539de8c8bb5290 not found: ID does not exist" containerID="32beb2afd66f353ed4699e3c4b1c5a1af20754b5290632a7a8539de8c8bb5290"
Oct 30 22:32:24.025342 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:24.025300    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32beb2afd66f353ed4699e3c4b1c5a1af20754b5290632a7a8539de8c8bb5290"} err="failed to get container status \"32beb2afd66f353ed4699e3c4b1c5a1af20754b5290632a7a8539de8c8bb5290\": rpc error: code = NotFound desc = could not find container \"32beb2afd66f353ed4699e3c4b1c5a1af20754b5290632a7a8539de8c8bb5290\": container with ID starting with 32beb2afd66f353ed4699e3c4b1c5a1af20754b5290632a7a8539de8c8bb5290 not found: ID does not exist"
Oct 30 22:32:24.206444 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:24.206367    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"]
Oct 30 22:32:24.255581 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:24.255547    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-b7588a-664bb4d97c-48pss"]
Oct 30 22:32:24.463640 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:24.463535    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:24.751549 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:24.751466    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:25.151550 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:25.151516    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:25.404017 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:25.403918    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="01bd8649-238e-4741-8291-f634efc5139e" path="/var/lib/kubelet/pods/01bd8649-238e-4741-8291-f634efc5139e/volumes"
Oct 30 22:32:25.463077 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:25.463036    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:26.091779 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:26.091744    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:26.329959 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:26.329922    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:27.001629 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:27.001583    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:32:28.538202 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:28.538164    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:29.889765 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:29.889726    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:32:30.771670 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.771630    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"]
Oct 30 22:32:30.772275 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.772254    5258 cpu_manager.go:414] "containerMap: removing container" podUID="01bd8649-238e-4741-8291-f634efc5139e" containerName="maas-api"
Oct 30 22:32:30.772376 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.772276    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="01bd8649-238e-4741-8291-f634efc5139e" containerName="maas-api"
Oct 30 22:32:30.772376 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.772310    5258 cpu_manager.go:414] "containerMap: removing container" podUID="769ff87d-8eca-48b8-ae57-27d2347ba07d" containerName="cleanup"
Oct 30 22:32:30.772376 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.772319    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="769ff87d-8eca-48b8-ae57-27d2347ba07d" containerName="cleanup"
Oct 30 22:32:30.772560 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.772467    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="bdc948e1-3516-469d-a39f-8531663ea68c" containerName="istio-proxy"
Oct 30 22:32:30.772560 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.772484    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="01bd8649-238e-4741-8291-f634efc5139e" containerName="maas-api"
Oct 30 22:32:30.772560 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.772495    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="e05348d0-23b5-49d1-8171-17f2ccbcd41a" containerName="cleanup"
Oct 30 22:32:30.779659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.779635    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:30.828283 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.828248    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:30.828685 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.828657    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-metrics-certs\") pod \"maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:30.828893 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.828873    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r6fl\" (UniqueName: \"kubernetes.io/projected/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-kube-api-access-2r6fl\") pod \"maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:30.829241 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.829220    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-maas-api-tls\") pod \"maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:30.885357 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.885303    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-cd5407-serving-cert\""
Oct 30 22:32:30.888800 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.888767    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"]
Oct 30 22:32:30.930642 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.930581    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:30.931090 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.930658    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-metrics-certs\") pod \"maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:30.931090 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.930707    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r6fl\" (UniqueName: \"kubernetes.io/projected/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-kube-api-access-2r6fl\") pod \"maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:30.931090 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.930866    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-maas-api-tls\") pod \"maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:30.931090 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:32:30.931063    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-serving-cert: secret "maas-api-e2e-inf-a-cd5407-serving-cert" not found
Oct 30 22:32:30.931262 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:32:30.931128    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-maas-api-tls podName:0c4c17af-3fd3-41e0-a5d3-92cad35330a0 nodeName:}" failed. No retries permitted until 2026-10-30 22:32:31.431112406 +0000 UTC m=+2266.161969527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-maas-api-tls") pod "maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6" (UID: "0c4c17af-3fd3-41e0-a5d3-92cad35330a0") : secret "maas-api-e2e-inf-a-cd5407-serving-cert" not found
Oct 30 22:32:30.931482 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.931456    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:30.933320 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:30.933296    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-metrics-certs\") pod \"maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:31.008490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:31.008454    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r6fl\" (UniqueName: \"kubernetes.io/projected/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-kube-api-access-2r6fl\") pod \"maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:31.210206 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:31.210170    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:31.439051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:31.439018    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-maas-api-tls\") pod \"maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:31.441642 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:31.441608    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-maas-api-tls\") pod \"maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:31.443635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:31.443579    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:31.661100 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:31.661061    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:31.713676 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:31.713632    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:32.097382 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:32.097355    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"]
Oct 30 22:32:32.098954 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:32:32.098930    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c4c17af_3fd3_41e0_a5d3_92cad35330a0.slice/crio-dff5dc625fcbeeb3902771f5b0bde7afbb519467f516c94e60207a6a4134fea9 WatchSource:0}: Error finding container dff5dc625fcbeeb3902771f5b0bde7afbb519467f516c94e60207a6a4134fea9: Status 404 returned error can't find the container with id dff5dc625fcbeeb3902771f5b0bde7afbb519467f516c94e60207a6a4134fea9
Oct 30 22:32:33.085300 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:33.085261    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6" event={"ID":"0c4c17af-3fd3-41e0-a5d3-92cad35330a0","Type":"ContainerStarted","Data":"b2077de83a5ad2924837eeb92cd56fb0babec7de1326240cbd3d0a2348e99873"}
Oct 30 22:32:33.085488 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:33.085360    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:33.085488 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:33.085386    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6" event={"ID":"0c4c17af-3fd3-41e0-a5d3-92cad35330a0","Type":"ContainerStarted","Data":"dff5dc625fcbeeb3902771f5b0bde7afbb519467f516c94e60207a6a4134fea9"}
Oct 30 22:32:33.205288 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:33.205195    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6" podStartSLOduration=2.403415848 podStartE2EDuration="3.205180396s" totalImagesPullingTime="801.764548ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:32:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:32:33.203532482 +0000 UTC m=+2267.934389625" watchObservedRunningTime="2026-10-30 22:32:33.205180396 +0000 UTC m=+2267.936037582"
Oct 30 22:32:35.587036 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:35.587000    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:35.805061 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:35.805026    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:35.947422 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:35.947348    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"]
Oct 30 22:32:35.947578 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:35.947546    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k" podUID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerName="istio-proxy" containerID="cri-o://f3ebe3a1209b98c3f7c6c92f463b4a67b834355d65d6946a1d255375def88ca6" gracePeriod=30
Oct 30 22:32:36.037971 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:36.037929    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:36.904103 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:36.904067    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:37.137898 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:37.137852    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:37.416155 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:37.416122    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:37.644242 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:37.644210    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:39.037493 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:39.037463    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:39.099189 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:39.099162    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:32:39.445035 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:39.444992    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:39.692022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:39.691984    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:41.153897 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.153732    5258 generic.go:356] "Generic (PLEG): container finished" podID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerID="f3ebe3a1209b98c3f7c6c92f463b4a67b834355d65d6946a1d255375def88ca6" exitCode=0
Oct 30 22:32:41.153897 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.153831    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k" event={"ID":"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8","Type":"ContainerDied","Data":"f3ebe3a1209b98c3f7c6c92f463b4a67b834355d65d6946a1d255375def88ca6"}
Oct 30 22:32:41.153897 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.153904    5258 scope.go:122] "RemoveContainer" containerID="ec3296d8e7e4ca39d4c55ae9bee5c6357ba9375afb937b395f2cd0ea60013a87"
Oct 30 22:32:41.224998 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.224942    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:32:41.369496 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.369468    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-kube-api-access-5285d\" (UniqueName: \"kubernetes.io/projected/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-kube-api-access-5285d\") pod \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") "
Oct 30 22:32:41.369708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.369538    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-credential-socket\") pod \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") "
Oct 30 22:32:41.369708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.369564    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-data\") pod \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") "
Oct 30 22:32:41.369708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.369634    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-token\" (UniqueName: \"kubernetes.io/projected/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-token\") pod \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") "
Oct 30 22:32:41.369708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.369664    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-podinfo\") pod \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") "
Oct 30 22:32:41.369708 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.369704    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-workload-socket\") pod \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") "
Oct 30 22:32:41.370007 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.369741    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-envoy\") pod \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") "
Oct 30 22:32:41.370007 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.369862    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istiod-ca-cert\") pod \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") "
Oct 30 22:32:41.370007 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.369837    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-credential-socket" pod "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" (UID: "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:41.370007 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.369895    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-data" pod "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" (UID: "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:41.370007 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.369937    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-workload-certs\") pod \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\" (UID: \"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8\") "
Oct 30 22:32:41.370284 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.370056    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-workload-socket" pod "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" (UID: "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:41.370284 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.370251    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-workload-certs" pod "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" (UID: "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:41.370699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.370583    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:41.370699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.370645    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:41.370699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.370660    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:41.370699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.370675    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:41.371317 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.371290    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istiod-ca-cert" pod "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" (UID: "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:32:41.372318 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.372289    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-kube-api-access-5285d" pod "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" (UID: "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8"). InnerVolumeSpecName "kube-api-access-5285d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:32:41.372520 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.372491    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-podinfo" pod "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" (UID: "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:32:41.372663 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.372628    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-token" pod "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" (UID: "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:32:41.372774 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.372745    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-envoy" pod "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" (UID: "c0aea57b-aa20-45dc-8d42-dfcf009bc6c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:41.471435 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.471391    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:41.471435 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.471423    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5285d\" (UniqueName: \"kubernetes.io/projected/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-kube-api-access-5285d\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:41.471435 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.471433    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:41.471435 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.471442    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:41.471868 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.471451    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:41.979384 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:41.979334    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:42.163030 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:42.162993    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k" event={"ID":"c0aea57b-aa20-45dc-8d42-dfcf009bc6c8","Type":"ContainerDied","Data":"2afbc855a782553b84928532a22b50ff942c1a5e45f5f0ee9ed42983bcddf65f"}
Oct 30 22:32:42.163524 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:42.163086    5258 scope.go:122] "RemoveContainer" containerID="f3ebe3a1209b98c3f7c6c92f463b4a67b834355d65d6946a1d255375def88ca6"
Oct 30 22:32:42.163524 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:42.163004    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"
Oct 30 22:32:42.380373 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:42.380338    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"]
Oct 30 22:32:42.430696 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:42.430665    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w5-b7588a-openshift-default-79b6489945-h8m2k"]
Oct 30 22:32:43.161146 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:32:43.161111    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:32:43.381929 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:43.381897    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" path="/var/lib/kubelet/pods/c0aea57b-aa20-45dc-8d42-dfcf009bc6c8/volumes"
Oct 30 22:32:43.410447 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:43.410419    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"]
Oct 30 22:32:43.410664 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:43.410632    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf" podUID="3718bc80-ba6b-49d4-8f03-b6cfe01588e1" containerName="istio-proxy" containerID="cri-o://982c33977300ff0a2658a296197b109fa44d6e7416c3b7596dc38a7263618251" gracePeriod=30
Oct 30 22:32:46.072253 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:46.072219    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:47.082065 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:47.082022    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:48.158886 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.158838    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:48.177681 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.177652    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-47fwf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:32:48.177824 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.177698    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf" podUID="3718bc80-ba6b-49d4-8f03-b6cfe01588e1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:32:48.499694 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.499661    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:48.677534 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.677511    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:32:48.853044 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.853010    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-data\") pod \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") "
Oct 30 22:32:48.853235 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.853055    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istiod-ca-cert\") pod \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") "
Oct 30 22:32:48.853235 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.853121    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-workload-certs\") pod \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") "
Oct 30 22:32:48.853235 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.853155    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-kube-api-access-gdnvz\" (UniqueName: \"kubernetes.io/projected/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-kube-api-access-gdnvz\") pod \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") "
Oct 30 22:32:48.853235 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.853186    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-podinfo\") pod \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") "
Oct 30 22:32:48.853452 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.853302    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-workload-socket\") pod \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") "
Oct 30 22:32:48.853452 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.853326    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-credential-socket\") pod \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") "
Oct 30 22:32:48.853452 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.853332    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-data" pod "3718bc80-ba6b-49d4-8f03-b6cfe01588e1" (UID: "3718bc80-ba6b-49d4-8f03-b6cfe01588e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:48.853452 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.853355    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-token\" (UniqueName: \"kubernetes.io/projected/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-token\") pod \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") "
Oct 30 22:32:48.853669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.853458    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-envoy\") pod \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\" (UID: \"3718bc80-ba6b-49d4-8f03-b6cfe01588e1\") "
Oct 30 22:32:48.853669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.853493    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istiod-ca-cert" pod "3718bc80-ba6b-49d4-8f03-b6cfe01588e1" (UID: "3718bc80-ba6b-49d4-8f03-b6cfe01588e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:32:48.853669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.853499    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-workload-certs" pod "3718bc80-ba6b-49d4-8f03-b6cfe01588e1" (UID: "3718bc80-ba6b-49d4-8f03-b6cfe01588e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:48.853822 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.853737    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-credential-socket" pod "3718bc80-ba6b-49d4-8f03-b6cfe01588e1" (UID: "3718bc80-ba6b-49d4-8f03-b6cfe01588e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:48.854070 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.854045    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-workload-socket" pod "3718bc80-ba6b-49d4-8f03-b6cfe01588e1" (UID: "3718bc80-ba6b-49d4-8f03-b6cfe01588e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:48.854275 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.854257    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:48.854275 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.854278    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:48.854412 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.854291    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:48.854412 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.854302    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:48.854412 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.854315    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:48.856043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.856012    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-token" pod "3718bc80-ba6b-49d4-8f03-b6cfe01588e1" (UID: "3718bc80-ba6b-49d4-8f03-b6cfe01588e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:32:48.856166 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.856056    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-kube-api-access-gdnvz" pod "3718bc80-ba6b-49d4-8f03-b6cfe01588e1" (UID: "3718bc80-ba6b-49d4-8f03-b6cfe01588e1"). InnerVolumeSpecName "kube-api-access-gdnvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:32:48.856237 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.856218    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-envoy" pod "3718bc80-ba6b-49d4-8f03-b6cfe01588e1" (UID: "3718bc80-ba6b-49d4-8f03-b6cfe01588e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:32:48.856427 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.856394    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-podinfo" pod "3718bc80-ba6b-49d4-8f03-b6cfe01588e1" (UID: "3718bc80-ba6b-49d4-8f03-b6cfe01588e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:32:48.955922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.955888    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:48.955922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.955918    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdnvz\" (UniqueName: \"kubernetes.io/projected/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-kube-api-access-gdnvz\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:48.955922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.955929    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:48.956156 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:48.955938    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3718bc80-ba6b-49d4-8f03-b6cfe01588e1-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:32:49.212659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:49.212556    5258 generic.go:356] "Generic (PLEG): container finished" podID="3718bc80-ba6b-49d4-8f03-b6cfe01588e1" containerID="982c33977300ff0a2658a296197b109fa44d6e7416c3b7596dc38a7263618251" exitCode=0
Oct 30 22:32:49.212659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:49.212632    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"
Oct 30 22:32:49.212659 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:49.212639    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf" event={"ID":"3718bc80-ba6b-49d4-8f03-b6cfe01588e1","Type":"ContainerDied","Data":"982c33977300ff0a2658a296197b109fa44d6e7416c3b7596dc38a7263618251"}
Oct 30 22:32:49.213143 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:49.212698    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf" event={"ID":"3718bc80-ba6b-49d4-8f03-b6cfe01588e1","Type":"ContainerDied","Data":"06056d0873648bf6487f21782bc72c0d4eaeadc1c40a41606ec5fdaa8e3f8c2e"}
Oct 30 22:32:49.213143 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:49.212722    5258 scope.go:122] "RemoveContainer" containerID="982c33977300ff0a2658a296197b109fa44d6e7416c3b7596dc38a7263618251"
Oct 30 22:32:49.224224 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:49.224208    5258 scope.go:122] "RemoveContainer" containerID="982c33977300ff0a2658a296197b109fa44d6e7416c3b7596dc38a7263618251"
Oct 30 22:32:49.224485 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:32:49.224464    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"982c33977300ff0a2658a296197b109fa44d6e7416c3b7596dc38a7263618251\": container with ID starting with 982c33977300ff0a2658a296197b109fa44d6e7416c3b7596dc38a7263618251 not found: ID does not exist" containerID="982c33977300ff0a2658a296197b109fa44d6e7416c3b7596dc38a7263618251"
Oct 30 22:32:49.224542 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:49.224492    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"982c33977300ff0a2658a296197b109fa44d6e7416c3b7596dc38a7263618251"} err="failed to get container status \"982c33977300ff0a2658a296197b109fa44d6e7416c3b7596dc38a7263618251\": rpc error: code = NotFound desc = could not find container \"982c33977300ff0a2658a296197b109fa44d6e7416c3b7596dc38a7263618251\": container with ID starting with 982c33977300ff0a2658a296197b109fa44d6e7416c3b7596dc38a7263618251 not found: ID does not exist"
Oct 30 22:32:49.381705 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:49.381681    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"]
Oct 30 22:32:49.429528 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:49.429500    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-47fwf"]
Oct 30 22:32:51.381697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:51.381663    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3718bc80-ba6b-49d4-8f03-b6cfe01588e1" path="/var/lib/kubelet/pods/3718bc80-ba6b-49d4-8f03-b6cfe01588e1/volumes"
Oct 30 22:32:51.449946 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:51.449914    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:53.045248 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:53.045214    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:53.569185 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:53.569139    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:53.783402 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:53.783362    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:54.051409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:54.051320    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:58.578647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:32:58.578608    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:01.604933 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:01.604898    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:01.828975 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:01.828935    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:01.908943 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:01.908856    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"]
Oct 30 22:33:01.909127 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:01.909086    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q" podUID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerName="istio-proxy" containerID="cri-o://6ba8970c1bf50fee275e620b8c5008871dda72a74f78b7af82d6dbb4883f7512" gracePeriod=30
Oct 30 22:33:02.075548 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:02.075511    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:03.888831 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:03.888797    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:07.176125 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.176057    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:33:07.298415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.298382    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2dcd803-1841-4a81-a92c-0f9814962b94-kube-api-access-zv87h\" (UniqueName: \"kubernetes.io/projected/d2dcd803-1841-4a81-a92c-0f9814962b94-kube-api-access-zv87h\") pod \"d2dcd803-1841-4a81-a92c-0f9814962b94\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") "
Oct 30 22:33:07.298415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.298431    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-token\" (UniqueName: \"kubernetes.io/projected/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-token\") pod \"d2dcd803-1841-4a81-a92c-0f9814962b94\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") "
Oct 30 22:33:07.298707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.298468    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-credential-socket\") pod \"d2dcd803-1841-4a81-a92c-0f9814962b94\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") "
Oct 30 22:33:07.298707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.298517    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-data\") pod \"d2dcd803-1841-4a81-a92c-0f9814962b94\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") "
Oct 30 22:33:07.298707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.298567    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-envoy\") pod \"d2dcd803-1841-4a81-a92c-0f9814962b94\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") "
Oct 30 22:33:07.298707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.298673    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-workload-socket\") pod \"d2dcd803-1841-4a81-a92c-0f9814962b94\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") "
Oct 30 22:33:07.298936 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.298734    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-podinfo\") pod \"d2dcd803-1841-4a81-a92c-0f9814962b94\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") "
Oct 30 22:33:07.298936 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.298788    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-workload-certs\") pod \"d2dcd803-1841-4a81-a92c-0f9814962b94\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") "
Oct 30 22:33:07.298936 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.298798    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-credential-socket" pod "d2dcd803-1841-4a81-a92c-0f9814962b94" (UID: "d2dcd803-1841-4a81-a92c-0f9814962b94"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:33:07.298936 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.298817    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2dcd803-1841-4a81-a92c-0f9814962b94-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2dcd803-1841-4a81-a92c-0f9814962b94-istiod-ca-cert\") pod \"d2dcd803-1841-4a81-a92c-0f9814962b94\" (UID: \"d2dcd803-1841-4a81-a92c-0f9814962b94\") "
Oct 30 22:33:07.299380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.299086    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-workload-socket" pod "d2dcd803-1841-4a81-a92c-0f9814962b94" (UID: "d2dcd803-1841-4a81-a92c-0f9814962b94"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:33:07.299380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.299223    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-workload-certs" pod "d2dcd803-1841-4a81-a92c-0f9814962b94" (UID: "d2dcd803-1841-4a81-a92c-0f9814962b94"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:33:07.299380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.299372    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2dcd803-1841-4a81-a92c-0f9814962b94-istiod-ca-cert" pod "d2dcd803-1841-4a81-a92c-0f9814962b94" (UID: "d2dcd803-1841-4a81-a92c-0f9814962b94"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:33:07.299542 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.299434    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:07.299542 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.299453    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:07.299542 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.299467    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:07.299728 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.299682    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-data" pod "d2dcd803-1841-4a81-a92c-0f9814962b94" (UID: "d2dcd803-1841-4a81-a92c-0f9814962b94"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:33:07.301312 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.301282    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2dcd803-1841-4a81-a92c-0f9814962b94-kube-api-access-zv87h" pod "d2dcd803-1841-4a81-a92c-0f9814962b94" (UID: "d2dcd803-1841-4a81-a92c-0f9814962b94"). InnerVolumeSpecName "kube-api-access-zv87h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:33:07.301464 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.301424    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-podinfo" pod "d2dcd803-1841-4a81-a92c-0f9814962b94" (UID: "d2dcd803-1841-4a81-a92c-0f9814962b94"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:33:07.301527 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.301459    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-token" pod "d2dcd803-1841-4a81-a92c-0f9814962b94" (UID: "d2dcd803-1841-4a81-a92c-0f9814962b94"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:33:07.301527 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.301459    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-envoy" pod "d2dcd803-1841-4a81-a92c-0f9814962b94" (UID: "d2dcd803-1841-4a81-a92c-0f9814962b94"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:33:07.346266 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.346240    5258 generic.go:356] "Generic (PLEG): container finished" podID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerID="6ba8970c1bf50fee275e620b8c5008871dda72a74f78b7af82d6dbb4883f7512" exitCode=0
Oct 30 22:33:07.346394 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.346291    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"
Oct 30 22:33:07.346394 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.346324    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q" event={"ID":"d2dcd803-1841-4a81-a92c-0f9814962b94","Type":"ContainerDied","Data":"6ba8970c1bf50fee275e620b8c5008871dda72a74f78b7af82d6dbb4883f7512"}
Oct 30 22:33:07.346394 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.346384    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q" event={"ID":"d2dcd803-1841-4a81-a92c-0f9814962b94","Type":"ContainerDied","Data":"ae185b6096adbac8284893261c5540d70bd66ffd64272bd08e8a0121b76ca81a"}
Oct 30 22:33:07.346497 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.346414    5258 scope.go:122] "RemoveContainer" containerID="6ba8970c1bf50fee275e620b8c5008871dda72a74f78b7af82d6dbb4883f7512"
Oct 30 22:33:07.360452 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.360432    5258 scope.go:122] "RemoveContainer" containerID="c5cba5d8ff1eb40d31cb19e4f4a7226c47128e0333a528ccacf23d1c816c1fd4"
Oct 30 22:33:07.371797 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.371775    5258 scope.go:122] "RemoveContainer" containerID="6ba8970c1bf50fee275e620b8c5008871dda72a74f78b7af82d6dbb4883f7512"
Oct 30 22:33:07.372081 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:33:07.372063    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ba8970c1bf50fee275e620b8c5008871dda72a74f78b7af82d6dbb4883f7512\": container with ID starting with 6ba8970c1bf50fee275e620b8c5008871dda72a74f78b7af82d6dbb4883f7512 not found: ID does not exist" containerID="6ba8970c1bf50fee275e620b8c5008871dda72a74f78b7af82d6dbb4883f7512"
Oct 30 22:33:07.372162 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.372088    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ba8970c1bf50fee275e620b8c5008871dda72a74f78b7af82d6dbb4883f7512"} err="failed to get container status \"6ba8970c1bf50fee275e620b8c5008871dda72a74f78b7af82d6dbb4883f7512\": rpc error: code = NotFound desc = could not find container \"6ba8970c1bf50fee275e620b8c5008871dda72a74f78b7af82d6dbb4883f7512\": container with ID starting with 6ba8970c1bf50fee275e620b8c5008871dda72a74f78b7af82d6dbb4883f7512 not found: ID does not exist"
Oct 30 22:33:07.372162 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.372106    5258 scope.go:122] "RemoveContainer" containerID="c5cba5d8ff1eb40d31cb19e4f4a7226c47128e0333a528ccacf23d1c816c1fd4"
Oct 30 22:33:07.372388 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:33:07.372364    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5cba5d8ff1eb40d31cb19e4f4a7226c47128e0333a528ccacf23d1c816c1fd4\": container with ID starting with c5cba5d8ff1eb40d31cb19e4f4a7226c47128e0333a528ccacf23d1c816c1fd4 not found: ID does not exist" containerID="c5cba5d8ff1eb40d31cb19e4f4a7226c47128e0333a528ccacf23d1c816c1fd4"
Oct 30 22:33:07.372489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.372392    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5cba5d8ff1eb40d31cb19e4f4a7226c47128e0333a528ccacf23d1c816c1fd4"} err="failed to get container status \"c5cba5d8ff1eb40d31cb19e4f4a7226c47128e0333a528ccacf23d1c816c1fd4\": rpc error: code = NotFound desc = could not find container \"c5cba5d8ff1eb40d31cb19e4f4a7226c47128e0333a528ccacf23d1c816c1fd4\": container with ID starting with c5cba5d8ff1eb40d31cb19e4f4a7226c47128e0333a528ccacf23d1c816c1fd4 not found: ID does not exist"
Oct 30 22:33:07.400553 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.400531    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:07.400762 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.400745    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2dcd803-1841-4a81-a92c-0f9814962b94-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:07.400891 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.400863    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv87h\" (UniqueName: \"kubernetes.io/projected/d2dcd803-1841-4a81-a92c-0f9814962b94-kube-api-access-zv87h\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:07.401022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.400889    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:07.401022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.400921    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:07.401022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.400934    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2dcd803-1841-4a81-a92c-0f9814962b94-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:07.514747 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.514673    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"]
Oct 30 22:33:07.521717 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:07.521686    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-13b8d8-openshift-default-55bd664645-xb85q"]
Oct 30 22:33:08.979280 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:08.979247    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:09.382172 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:09.382138    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2dcd803-1841-4a81-a92c-0f9814962b94" path="/var/lib/kubelet/pods/d2dcd803-1841-4a81-a92c-0f9814962b94/volumes"
Oct 30 22:33:10.060429 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:10.060394    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:13.160422 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:33:13.160382    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:33:13.453068 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.452990    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"]
Oct 30 22:33:13.453539 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.453523    5258 cpu_manager.go:414] "containerMap: removing container" podUID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerName="istio-proxy"
Oct 30 22:33:13.453632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.453540    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerName="istio-proxy"
Oct 30 22:33:13.453632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.453553    5258 cpu_manager.go:414] "containerMap: removing container" podUID="3718bc80-ba6b-49d4-8f03-b6cfe01588e1" containerName="istio-proxy"
Oct 30 22:33:13.453632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.453558    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3718bc80-ba6b-49d4-8f03-b6cfe01588e1" containerName="istio-proxy"
Oct 30 22:33:13.453632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.453566    5258 cpu_manager.go:414] "containerMap: removing container" podUID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerName="istio-proxy"
Oct 30 22:33:13.453632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.453570    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerName="istio-proxy"
Oct 30 22:33:13.453632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.453584    5258 cpu_manager.go:414] "containerMap: removing container" podUID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerName="istio-proxy"
Oct 30 22:33:13.453632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.453603    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerName="istio-proxy"
Oct 30 22:33:13.453632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.453621    5258 cpu_manager.go:414] "containerMap: removing container" podUID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerName="istio-proxy"
Oct 30 22:33:13.453632 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.453626    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerName="istio-proxy"
Oct 30 22:33:13.453951 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.453739    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerName="istio-proxy"
Oct 30 22:33:13.453951 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.453748    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="3718bc80-ba6b-49d4-8f03-b6cfe01588e1" containerName="istio-proxy"
Oct 30 22:33:13.453951 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.453755    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerName="istio-proxy"
Oct 30 22:33:13.453951 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.453763    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0aea57b-aa20-45dc-8d42-dfcf009bc6c8" containerName="istio-proxy"
Oct 30 22:33:13.457478 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.457459    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.570750 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.570719    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.570877 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.570821    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.570877 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.570855    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/825006b6-171c-4fcb-9dbd-b875d8abbca2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.570960 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.570887    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5rv8\" (UniqueName: \"kubernetes.io/projected/825006b6-171c-4fcb-9dbd-b875d8abbca2-kube-api-access-h5rv8\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.570996 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.570977    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.571030 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.571011    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.571152 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.571134    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.571188 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.571175    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.571316 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.571299    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.673462 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.673424    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"]
Oct 30 22:33:13.674050 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.674023    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.674186 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.674103    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.674186 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.674165    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.674322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.674193    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/825006b6-171c-4fcb-9dbd-b875d8abbca2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.674322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.674231    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5rv8\" (UniqueName: \"kubernetes.io/projected/825006b6-171c-4fcb-9dbd-b875d8abbca2-kube-api-access-h5rv8\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.674322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.674268    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.674322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.674296    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.674616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.674368    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.674616 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.674407    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.674897 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.674873    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.675158 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.675136    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.676469 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.676424    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.676746 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.676721    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.676938 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.676912    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/825006b6-171c-4fcb-9dbd-b875d8abbca2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.681652 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.680236    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.681652 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.680533    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.737736 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.737666    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.738932 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.738905    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5rv8\" (UniqueName: \"kubernetes.io/projected/825006b6-171c-4fcb-9dbd-b875d8abbca2-kube-api-access-h5rv8\") pod \"maas-default-gateway-openshift-default-76597d6855-vc8jn\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:13.771466 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:13.771431    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:14.018504 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:14.018401    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:14.213604 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:14.213565    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"]
Oct 30 22:33:14.214745 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:33:14.214720    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod825006b6_171c_4fcb_9dbd_b875d8abbca2.slice/crio-bfc7ff7303ef4f2be91098a44890c108d9e00e9b1e0916cb24f71dfc89f896b9 WatchSource:0}: Error finding container bfc7ff7303ef4f2be91098a44890c108d9e00e9b1e0916cb24f71dfc89f896b9: Status 404 returned error can't find the container with id bfc7ff7303ef4f2be91098a44890c108d9e00e9b1e0916cb24f71dfc89f896b9
Oct 30 22:33:14.217107 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:14.217076    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:33:14.217176 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:14.217138    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:33:14.217176 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:14.217170    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:33:14.400992 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:14.400941    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn" event={"ID":"825006b6-171c-4fcb-9dbd-b875d8abbca2","Type":"ContainerStarted","Data":"ff22299e9ec1fd859478ade447070ac03bc5ae600eda6e8bea03eaf975a2d92b"}
Oct 30 22:33:14.401169 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:14.401011    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn" event={"ID":"825006b6-171c-4fcb-9dbd-b875d8abbca2","Type":"ContainerStarted","Data":"bfc7ff7303ef4f2be91098a44890c108d9e00e9b1e0916cb24f71dfc89f896b9"}
Oct 30 22:33:14.524213 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:14.524102    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn" podStartSLOduration=1.524083724 podStartE2EDuration="1.524083724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:33:14.522726323 +0000 UTC m=+2309.253583479" watchObservedRunningTime="2026-10-30 22:33:14.524083724 +0000 UTC m=+2309.254940867"
Oct 30 22:33:14.772613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:14.771698    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:15.778269 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:15.778230    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vc8jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:33:15.778882 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:15.778850    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn" podUID="825006b6-171c-4fcb-9dbd-b875d8abbca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:33:16.775645 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:16.773910    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vc8jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:33:16.775645 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:16.773969    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn" podUID="825006b6-171c-4fcb-9dbd-b875d8abbca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:33:17.773969 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:17.773923    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vc8jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:33:17.778634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:17.774025    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn" podUID="825006b6-171c-4fcb-9dbd-b875d8abbca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:33:17.792255 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:17.792212    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:18.772001 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:18.771961    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vc8jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:33:18.772310 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:18.772278    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn" podUID="825006b6-171c-4fcb-9dbd-b875d8abbca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:33:18.870257 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:18.870220    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"]
Oct 30 22:33:18.871057 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:18.871023    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8" podUID="45402f0f-cea0-4618-aed3-6a60dfa50c20" containerName="maas-api" containerID="cri-o://1418bfe2461a22252dc112bcb1f89e49516a144773c8aab7c7edf36fb5089a8b" gracePeriod=30
Oct 30 22:33:19.039925 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.039810    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:19.228424 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.228402    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:33:19.282195 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.282155    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/45402f0f-cea0-4618-aed3-6a60dfa50c20-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45402f0f-cea0-4618-aed3-6a60dfa50c20-openshift-service-ca\") pod \"45402f0f-cea0-4618-aed3-6a60dfa50c20\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") "
Oct 30 22:33:19.282399 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.282291    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-maas-api-tls\") pod \"45402f0f-cea0-4618-aed3-6a60dfa50c20\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") "
Oct 30 22:33:19.282473 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.282444    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-metrics-certs\" (UniqueName: \"kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-metrics-certs\") pod \"45402f0f-cea0-4618-aed3-6a60dfa50c20\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") "
Oct 30 22:33:19.282626 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.282562    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45402f0f-cea0-4618-aed3-6a60dfa50c20-kube-api-access-lhft5\" (UniqueName: \"kubernetes.io/projected/45402f0f-cea0-4618-aed3-6a60dfa50c20-kube-api-access-lhft5\") pod \"45402f0f-cea0-4618-aed3-6a60dfa50c20\" (UID: \"45402f0f-cea0-4618-aed3-6a60dfa50c20\") "
Oct 30 22:33:19.283510 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.283452    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45402f0f-cea0-4618-aed3-6a60dfa50c20-openshift-service-ca" pod "45402f0f-cea0-4618-aed3-6a60dfa50c20" (UID: "45402f0f-cea0-4618-aed3-6a60dfa50c20"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:33:19.285433 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.285391    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-maas-api-tls" pod "45402f0f-cea0-4618-aed3-6a60dfa50c20" (UID: "45402f0f-cea0-4618-aed3-6a60dfa50c20"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:33:19.285964 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.285933    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-metrics-certs" pod "45402f0f-cea0-4618-aed3-6a60dfa50c20" (UID: "45402f0f-cea0-4618-aed3-6a60dfa50c20"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:33:19.286435 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.286410    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45402f0f-cea0-4618-aed3-6a60dfa50c20-kube-api-access-lhft5" pod "45402f0f-cea0-4618-aed3-6a60dfa50c20" (UID: "45402f0f-cea0-4618-aed3-6a60dfa50c20"). InnerVolumeSpecName "kube-api-access-lhft5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:33:19.404668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.384691    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhft5\" (UniqueName: \"kubernetes.io/projected/45402f0f-cea0-4618-aed3-6a60dfa50c20-kube-api-access-lhft5\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:19.404987 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.404959    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45402f0f-cea0-4618-aed3-6a60dfa50c20-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:19.405142 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.405125    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:19.405278 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.405264    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45402f0f-cea0-4618-aed3-6a60dfa50c20-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:19.437081 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.437050    5258 generic.go:356] "Generic (PLEG): container finished" podID="45402f0f-cea0-4618-aed3-6a60dfa50c20" containerID="1418bfe2461a22252dc112bcb1f89e49516a144773c8aab7c7edf36fb5089a8b" exitCode=0
Oct 30 22:33:19.437249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.437105    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"
Oct 30 22:33:19.437249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.437138    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8" event={"ID":"45402f0f-cea0-4618-aed3-6a60dfa50c20","Type":"ContainerDied","Data":"1418bfe2461a22252dc112bcb1f89e49516a144773c8aab7c7edf36fb5089a8b"}
Oct 30 22:33:19.437249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.437196    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8" event={"ID":"45402f0f-cea0-4618-aed3-6a60dfa50c20","Type":"ContainerDied","Data":"45f1a6b6c7bc797256a2502b06c88330ec1b7fda5a02f8496d39b57482496aa6"}
Oct 30 22:33:19.437249 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.437219    5258 scope.go:122] "RemoveContainer" containerID="1418bfe2461a22252dc112bcb1f89e49516a144773c8aab7c7edf36fb5089a8b"
Oct 30 22:33:19.447217 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.447190    5258 scope.go:122] "RemoveContainer" containerID="1418bfe2461a22252dc112bcb1f89e49516a144773c8aab7c7edf36fb5089a8b"
Oct 30 22:33:19.447507 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:33:19.447488    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1418bfe2461a22252dc112bcb1f89e49516a144773c8aab7c7edf36fb5089a8b\": container with ID starting with 1418bfe2461a22252dc112bcb1f89e49516a144773c8aab7c7edf36fb5089a8b not found: ID does not exist" containerID="1418bfe2461a22252dc112bcb1f89e49516a144773c8aab7c7edf36fb5089a8b"
Oct 30 22:33:19.447562 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.447515    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1418bfe2461a22252dc112bcb1f89e49516a144773c8aab7c7edf36fb5089a8b"} err="failed to get container status \"1418bfe2461a22252dc112bcb1f89e49516a144773c8aab7c7edf36fb5089a8b\": rpc error: code = NotFound desc = could not find container \"1418bfe2461a22252dc112bcb1f89e49516a144773c8aab7c7edf36fb5089a8b\": container with ID starting with 1418bfe2461a22252dc112bcb1f89e49516a144773c8aab7c7edf36fb5089a8b not found: ID does not exist"
Oct 30 22:33:19.607612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.605787    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"]
Oct 30 22:33:19.608981 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.608954    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-77cb1f-f7d6858d8-456d8"]
Oct 30 22:33:19.776612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.773335    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vc8jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:33:19.776612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:19.773403    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn" podUID="825006b6-171c-4fcb-9dbd-b875d8abbca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:33:20.772699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:20.772649    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vc8jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:33:20.773107 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:20.772725    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn" podUID="825006b6-171c-4fcb-9dbd-b875d8abbca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:33:20.853569 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:20.853533    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:21.153846 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:21.152756    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:21.371509 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:21.371474    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:21.382808 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:21.382776    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45402f0f-cea0-4618-aed3-6a60dfa50c20" path="/var/lib/kubelet/pods/45402f0f-cea0-4618-aed3-6a60dfa50c20/volumes"
Oct 30 22:33:21.858943 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:21.858894    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:22.616140 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:22.616100    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:22.616505 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:22.616476    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:22.617531 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:22.617512    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:33:22.917918 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:22.917823    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:33:26.579909 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:26.579849    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:27.802047 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:27.802007    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:28.371526 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:28.371489    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:28.834995 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:28.834958    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:29.668535 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.668503    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:29.689540 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.689502    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"]
Oct 30 22:33:29.690352 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.690328    5258 cpu_manager.go:414] "containerMap: removing container" podUID="45402f0f-cea0-4618-aed3-6a60dfa50c20" containerName="maas-api"
Oct 30 22:33:29.693738 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.693715    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45402f0f-cea0-4618-aed3-6a60dfa50c20" containerName="maas-api"
Oct 30 22:33:29.694085 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.694058    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="45402f0f-cea0-4618-aed3-6a60dfa50c20" containerName="maas-api"
Oct 30 22:33:29.694207 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.694089    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2dcd803-1841-4a81-a92c-0f9814962b94" containerName="istio-proxy"
Oct 30 22:33:29.700775 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.700754    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.732047 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.729511    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3982e61-9743-45e3-936e-826d18355971-istio-token\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.732047 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.729635    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-credential-socket\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.732047 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.729686    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-istio-data\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.732047 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.729832    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3982e61-9743-45e3-936e-826d18355971-istiod-ca-cert\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.732047 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.729894    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8wh2\" (UniqueName: \"kubernetes.io/projected/c3982e61-9743-45e3-936e-826d18355971-kube-api-access-m8wh2\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.732047 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.730037    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-workload-socket\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.732047 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.730098    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3982e61-9743-45e3-936e-826d18355971-istio-podinfo\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.732047 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.730230    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-workload-certs\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.732047 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.730266    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-istio-envoy\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.762069 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.762035    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"]
Oct 30 22:33:29.806010 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.805978    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e54161-openshift-default-dockercfg-dc5xx\""
Oct 30 22:33:29.831300 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.831260    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-workload-certs\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.831725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.831322    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-istio-envoy\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.831725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.831406    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3982e61-9743-45e3-936e-826d18355971-istio-token\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.831725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.831464    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-credential-socket\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.831725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.831504    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-istio-data\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.831725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.831542    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3982e61-9743-45e3-936e-826d18355971-istiod-ca-cert\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.831725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.831575    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8wh2\" (UniqueName: \"kubernetes.io/projected/c3982e61-9743-45e3-936e-826d18355971-kube-api-access-m8wh2\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.831725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.831688    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-workload-socket\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.831725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.831718    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3982e61-9743-45e3-936e-826d18355971-istio-podinfo\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.832323 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.831746    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-workload-certs\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.833043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.832691    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-credential-socket\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.833043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.832931    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-istio-data\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.833466 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.833441    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-workload-socket\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.833668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.833607    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3982e61-9743-45e3-936e-826d18355971-istiod-ca-cert\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.835878 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.835826    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3982e61-9743-45e3-936e-826d18355971-istio-podinfo\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.836370 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.835980    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-istio-envoy\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.903754 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.903721    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8wh2\" (UniqueName: \"kubernetes.io/projected/c3982e61-9743-45e3-936e-826d18355971-kube-api-access-m8wh2\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.905222 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.905192    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3982e61-9743-45e3-936e-826d18355971-istio-token\") pod \"e2e-inf-b-e54161-openshift-default-7899496757-cmj5t\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") " pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:29.908475 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:29.908444    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:30.016956 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:30.016872    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:30.145554 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:30.135229    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:30.493967 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:30.493938    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"]
Oct 30 22:33:30.495694 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:33:30.495662    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3982e61_9743_45e3_936e_826d18355971.slice/crio-402025ec8088ce475a1552676a0bcef6b7c8bb92e6ad166d067a27d027c97d24 WatchSource:0}: Error finding container 402025ec8088ce475a1552676a0bcef6b7c8bb92e6ad166d067a27d027c97d24: Status 404 returned error can't find the container with id 402025ec8088ce475a1552676a0bcef6b7c8bb92e6ad166d067a27d027c97d24
Oct 30 22:33:30.498094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:30.498054    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:33:30.498203 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:30.498162    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:33:30.498268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:30.498213    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:33:30.517883 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:30.517854    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t" event={"ID":"c3982e61-9743-45e3-936e-826d18355971","Type":"ContainerStarted","Data":"402025ec8088ce475a1552676a0bcef6b7c8bb92e6ad166d067a27d027c97d24"}
Oct 30 22:33:31.525974 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:31.525937    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t" event={"ID":"c3982e61-9743-45e3-936e-826d18355971","Type":"ContainerStarted","Data":"8faeb63196ef9e327826f685e5dc9cee7f462948e03dbcd2d18c74e8d385a622"}
Oct 30 22:33:31.699804 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:31.699749    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t" podStartSLOduration=2.699734639 podStartE2EDuration="2.699734639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:33:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:33:31.696465897 +0000 UTC m=+2326.427323067" watchObservedRunningTime="2026-10-30 22:33:31.699734639 +0000 UTC m=+2326.430591782"
Oct 30 22:33:32.018135 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:32.018100    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:32.023202 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:32.023176    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:32.253437 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:32.253397    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:32.532974 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:32.532944    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:32.533900 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:32.533872    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:33:34.750951 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:34.750919    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:34.967556 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:34.967520    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:37.705000 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:37.704960    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:38.003668 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:38.003389    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:38.293265 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:38.293169    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:39.573040 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:39.573003    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:39.847439 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:39.847364    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:41.548006 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:41.547972    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:41.786305 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:41.786270    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:42.884331 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:42.884283    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:43.161156 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:33:43.161075    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:33:47.929352 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:47.929306    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:52.952210 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:52.952175    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:57.143521 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.143440    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"]
Oct 30 22:33:57.143969 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.143690    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf" podUID="abcf45e3-22ba-45f2-b9cc-d80f8ac763cd" containerName="maas-api" containerID="cri-o://53f74513cdab779368b39557f1958d7505b16c60455d02f16ead699be39f28bf" gracePeriod=30
Oct 30 22:33:57.311764 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.311723    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:57.448978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.448957    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:33:57.469471 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.469439    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-openshift-service-ca\") pod \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") "
Oct 30 22:33:57.469603 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.469517    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-kube-api-access-8fvcb\" (UniqueName: \"kubernetes.io/projected/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-kube-api-access-8fvcb\") pod \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") "
Oct 30 22:33:57.469691 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.469666    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-metrics-certs\" (UniqueName: \"kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-metrics-certs\") pod \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") "
Oct 30 22:33:57.469798 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.469779    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-maas-api-tls\") pod \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\" (UID: \"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd\") "
Oct 30 22:33:57.469877 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.469799    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-openshift-service-ca" pod "abcf45e3-22ba-45f2-b9cc-d80f8ac763cd" (UID: "abcf45e3-22ba-45f2-b9cc-d80f8ac763cd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:33:57.470523 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.470317    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:57.472207 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.472185    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-kube-api-access-8fvcb" pod "abcf45e3-22ba-45f2-b9cc-d80f8ac763cd" (UID: "abcf45e3-22ba-45f2-b9cc-d80f8ac763cd"). InnerVolumeSpecName "kube-api-access-8fvcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:33:57.472207 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.472192    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-maas-api-tls" pod "abcf45e3-22ba-45f2-b9cc-d80f8ac763cd" (UID: "abcf45e3-22ba-45f2-b9cc-d80f8ac763cd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:33:57.472338 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.472216    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-metrics-certs" pod "abcf45e3-22ba-45f2-b9cc-d80f8ac763cd" (UID: "abcf45e3-22ba-45f2-b9cc-d80f8ac763cd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:33:57.573159 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.573054    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:57.573159 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.573091    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fvcb\" (UniqueName: \"kubernetes.io/projected/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-kube-api-access-8fvcb\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:57.573159 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.573108    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:33:57.718283 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.718194    5258 generic.go:356] "Generic (PLEG): container finished" podID="abcf45e3-22ba-45f2-b9cc-d80f8ac763cd" containerID="53f74513cdab779368b39557f1958d7505b16c60455d02f16ead699be39f28bf" exitCode=0
Oct 30 22:33:57.718283 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.718245    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"
Oct 30 22:33:57.718283 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.718258    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf" event={"ID":"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd","Type":"ContainerDied","Data":"53f74513cdab779368b39557f1958d7505b16c60455d02f16ead699be39f28bf"}
Oct 30 22:33:57.718531 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.718304    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf" event={"ID":"abcf45e3-22ba-45f2-b9cc-d80f8ac763cd","Type":"ContainerDied","Data":"3e3ff78d383d6f52764170fd389bd86b7238ee57e80cc69a5c84134e3132fa95"}
Oct 30 22:33:57.718531 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.718330    5258 scope.go:122] "RemoveContainer" containerID="53f74513cdab779368b39557f1958d7505b16c60455d02f16ead699be39f28bf"
Oct 30 22:33:57.732530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.732497    5258 scope.go:122] "RemoveContainer" containerID="53f74513cdab779368b39557f1958d7505b16c60455d02f16ead699be39f28bf"
Oct 30 22:33:57.732879 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:33:57.732858    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53f74513cdab779368b39557f1958d7505b16c60455d02f16ead699be39f28bf\": container with ID starting with 53f74513cdab779368b39557f1958d7505b16c60455d02f16ead699be39f28bf not found: ID does not exist" containerID="53f74513cdab779368b39557f1958d7505b16c60455d02f16ead699be39f28bf"
Oct 30 22:33:57.732973 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.732888    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53f74513cdab779368b39557f1958d7505b16c60455d02f16ead699be39f28bf"} err="failed to get container status \"53f74513cdab779368b39557f1958d7505b16c60455d02f16ead699be39f28bf\": rpc error: code = NotFound desc = could not find container \"53f74513cdab779368b39557f1958d7505b16c60455d02f16ead699be39f28bf\": container with ID starting with 53f74513cdab779368b39557f1958d7505b16c60455d02f16ead699be39f28bf not found: ID does not exist"
Oct 30 22:33:57.886676 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.886645    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"]
Oct 30 22:33:57.889308 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:57.889287    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-18515933-ffcdcbffc-9g2lf"]
Oct 30 22:33:58.883518 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:58.883475    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:59.151726 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:59.151581    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:59.383516 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:59.383480    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="abcf45e3-22ba-45f2-b9cc-d80f8ac763cd" path="/var/lib/kubelet/pods/abcf45e3-22ba-45f2-b9cc-d80f8ac763cd/volumes"
Oct 30 22:33:59.411211 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:59.411117    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:59.921253 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:33:59.921225    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:00.240904 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:00.240832    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:34:04.487363 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:04.487325    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:05.110684 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:05.110651    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:09.569985 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:09.569885    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:13.164146 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:34:13.164107    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:34:14.566261 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:14.566218    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:19.320869 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.320826    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"]
Oct 30 22:34:19.321647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.321622    5258 cpu_manager.go:414] "containerMap: removing container" podUID="abcf45e3-22ba-45f2-b9cc-d80f8ac763cd" containerName="maas-api"
Oct 30 22:34:19.321647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.321645    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="abcf45e3-22ba-45f2-b9cc-d80f8ac763cd" containerName="maas-api"
Oct 30 22:34:19.321829 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.321800    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="abcf45e3-22ba-45f2-b9cc-d80f8ac763cd" containerName="maas-api"
Oct 30 22:34:19.325314 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.325291    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:19.417277 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.417248    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e54161-74d94d548c-qckbd\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:19.417438 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.417297    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-maas-api-tls\") pod \"maas-api-e2e-inf-b-e54161-74d94d548c-qckbd\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:19.417507 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.417482    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-metrics-certs\") pod \"maas-api-e2e-inf-b-e54161-74d94d548c-qckbd\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:19.417546 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.417536    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6wfl\" (UniqueName: \"kubernetes.io/projected/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-kube-api-access-h6wfl\") pod \"maas-api-e2e-inf-b-e54161-74d94d548c-qckbd\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:19.419932 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.419906    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e54161-serving-cert\""
Oct 30 22:34:19.430200 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.430172    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"]
Oct 30 22:34:19.518908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.518872    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-maas-api-tls\") pod \"maas-api-e2e-inf-b-e54161-74d94d548c-qckbd\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:19.519074 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:34:19.519023    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-serving-cert: secret "maas-api-e2e-inf-b-e54161-serving-cert" not found
Oct 30 22:34:19.519139 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.519026    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-metrics-certs\") pod \"maas-api-e2e-inf-b-e54161-74d94d548c-qckbd\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:19.519139 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:34:19.519096    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-maas-api-tls podName:2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a nodeName:}" failed. No retries permitted until 2026-10-30 22:34:20.019077531 +0000 UTC m=+2374.749934667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-maas-api-tls") pod "maas-api-e2e-inf-b-e54161-74d94d548c-qckbd" (UID: "2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a") : secret "maas-api-e2e-inf-b-e54161-serving-cert" not found
Oct 30 22:34:19.519253 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.519203    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6wfl\" (UniqueName: \"kubernetes.io/projected/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-kube-api-access-h6wfl\") pod \"maas-api-e2e-inf-b-e54161-74d94d548c-qckbd\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:19.519318 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.519257    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e54161-74d94d548c-qckbd\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:19.519899 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.519874    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e54161-74d94d548c-qckbd\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:19.521399 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.521372    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-metrics-certs\") pod \"maas-api-e2e-inf-b-e54161-74d94d548c-qckbd\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:19.584302 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.584226    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6wfl\" (UniqueName: \"kubernetes.io/projected/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-kube-api-access-h6wfl\") pod \"maas-api-e2e-inf-b-e54161-74d94d548c-qckbd\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:19.616881 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.616837    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:19.855416 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:19.855330    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:20.025179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:20.025146    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-maas-api-tls\") pod \"maas-api-e2e-inf-b-e54161-74d94d548c-qckbd\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:20.027514 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:20.027490    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-maas-api-tls\") pod \"maas-api-e2e-inf-b-e54161-74d94d548c-qckbd\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:20.103065 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:20.103031    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:20.238874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:20.238795    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:20.634841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:20.634807    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"]
Oct 30 22:34:20.635974 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:34:20.635944    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2148eb8f_5b97_4c9d_b8f3_b04dfe049e0a.slice/crio-cbd5e38e90017c265604a078b52bd05e7aaa6fa051632673a06dda2339aaa927 WatchSource:0}: Error finding container cbd5e38e90017c265604a078b52bd05e7aaa6fa051632673a06dda2339aaa927: Status 404 returned error can't find the container with id cbd5e38e90017c265604a078b52bd05e7aaa6fa051632673a06dda2339aaa927
Oct 30 22:34:20.778945 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:20.778908    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:20.893880 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:20.893795    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd" event={"ID":"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a","Type":"ContainerStarted","Data":"cbd5e38e90017c265604a078b52bd05e7aaa6fa051632673a06dda2339aaa927"}
Oct 30 22:34:21.903267 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:21.903169    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd" event={"ID":"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a","Type":"ContainerStarted","Data":"3c92fdf9444a60d68804beffedd9a93e5bfe3f28da98de4398f2e1f6e5290b42"}
Oct 30 22:34:21.903267 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:21.903239    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:22.023776 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:22.023719    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd" podStartSLOduration=2.08181933 podStartE2EDuration="3.023705294s" totalImagesPullingTime="941.885964ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:34:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:34:22.021855643 +0000 UTC m=+2376.752712787" watchObservedRunningTime="2026-10-30 22:34:22.023705294 +0000 UTC m=+2376.754562436"
Oct 30 22:34:24.882575 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:24.882536    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:27.879382 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:27.879349    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:34:27.916002 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:27.915975    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:34:28.183949 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:28.183859    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:29.211731 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:29.211698    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:29.440074 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:29.440042    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:32.004031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:32.003991    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:35.182368 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:35.182331    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:40.096035 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:40.095815    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:40.332020 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:40.331963    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:42.215707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:42.215666    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:43.163714 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:34:43.163672    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:34:43.889048 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:43.889010    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:45.150809 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:45.150772    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"]
Oct 30 22:34:45.352787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:45.352752    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:45.594657 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:45.594617    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:45.772069 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:45.772036    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:34:45.774904 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:45.774879    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:34:50.576028 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:50.575990    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:50.907880 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:50.907766    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:51.221618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:51.221524    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:51.544001 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:51.543918    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"]
Oct 30 22:34:51.998006 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:51.997971    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:52.245351 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:52.245308    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:56.207581 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:56.207517    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:56.545123 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:56.545037    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj" podUID="2ddb2f4d-1a6e-4b97-bada-6997a01536d1" containerName="payload-processing" containerID="cri-o://f4aa2f49f508204679a5d8324906e07a0c649e87c9da39309c234e089d1d7b8e" gracePeriod=25
Oct 30 22:34:58.484110 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:34:58.484072    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj" podUID="2ddb2f4d-1a6e-4b97-bada-6997a01536d1" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:35:00.177743 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.177695    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main" containerID="cri-o://4afc0191771c604ae4f42369e46a2cdbe8973bd1ce214e50143877b79c5e57d3" gracePeriod=45
Oct 30 22:35:00.458542 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.458517    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:35:00.637714 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.636572    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-tmp-dir\") pod \"fa100c4d-158f-4995-b648-b5524aa575b5\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") "
Oct 30 22:35:00.637714 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.636684    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-home\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-home\") pod \"fa100c4d-158f-4995-b648-b5524aa575b5\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") "
Oct 30 22:35:00.637714 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.636724    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-model-cache\") pod \"fa100c4d-158f-4995-b648-b5524aa575b5\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") "
Oct 30 22:35:00.637714 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.636899    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa100c4d-158f-4995-b648-b5524aa575b5-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa100c4d-158f-4995-b648-b5524aa575b5-tls-certs\") pod \"fa100c4d-158f-4995-b648-b5524aa575b5\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") "
Oct 30 22:35:00.637714 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.636987    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa100c4d-158f-4995-b648-b5524aa575b5-kube-api-access-z5hcv\" (UniqueName: \"kubernetes.io/projected/fa100c4d-158f-4995-b648-b5524aa575b5-kube-api-access-z5hcv\") pod \"fa100c4d-158f-4995-b648-b5524aa575b5\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") "
Oct 30 22:35:00.637714 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.637043    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-dshm\") pod \"fa100c4d-158f-4995-b648-b5524aa575b5\" (UID: \"fa100c4d-158f-4995-b648-b5524aa575b5\") "
Oct 30 22:35:00.640820 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.638060    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-model-cache" pod "fa100c4d-158f-4995-b648-b5524aa575b5" (UID: "fa100c4d-158f-4995-b648-b5524aa575b5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:00.640820 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.638259    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-tmp-dir" pod "fa100c4d-158f-4995-b648-b5524aa575b5" (UID: "fa100c4d-158f-4995-b648-b5524aa575b5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:00.640820 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.638435    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-home" pod "fa100c4d-158f-4995-b648-b5524aa575b5" (UID: "fa100c4d-158f-4995-b648-b5524aa575b5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:00.642056 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.642011    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa100c4d-158f-4995-b648-b5524aa575b5-tls-certs" pod "fa100c4d-158f-4995-b648-b5524aa575b5" (UID: "fa100c4d-158f-4995-b648-b5524aa575b5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:35:00.644851 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.644822    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa100c4d-158f-4995-b648-b5524aa575b5-kube-api-access-z5hcv" pod "fa100c4d-158f-4995-b648-b5524aa575b5" (UID: "fa100c4d-158f-4995-b648-b5524aa575b5"). InnerVolumeSpecName "kube-api-access-z5hcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:00.645989 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.645956    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-dshm" pod "fa100c4d-158f-4995-b648-b5524aa575b5" (UID: "fa100c4d-158f-4995-b648-b5524aa575b5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:00.738916 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.738885    5258 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa100c4d-158f-4995-b648-b5524aa575b5-tls-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:00.738916 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.738915    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5hcv\" (UniqueName: \"kubernetes.io/projected/fa100c4d-158f-4995-b648-b5524aa575b5-kube-api-access-z5hcv\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:00.739101 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.738926    5258 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-dshm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:00.739101 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.738935    5258 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-tmp-dir\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:00.739101 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.738943    5258 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-home\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:00.739101 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:00.738951    5258 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa100c4d-158f-4995-b648-b5524aa575b5-model-cache\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:01.187781 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.187741    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:01.253009 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.252973    5258 generic.go:356] "Generic (PLEG): container finished" podID="fa100c4d-158f-4995-b648-b5524aa575b5" containerID="4afc0191771c604ae4f42369e46a2cdbe8973bd1ce214e50143877b79c5e57d3" exitCode=0
Oct 30 22:35:01.253177 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.253023    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"
Oct 30 22:35:01.253177 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.253063    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" event={"ID":"fa100c4d-158f-4995-b648-b5524aa575b5","Type":"ContainerDied","Data":"4afc0191771c604ae4f42369e46a2cdbe8973bd1ce214e50143877b79c5e57d3"}
Oct 30 22:35:01.253177 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.253133    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk" event={"ID":"fa100c4d-158f-4995-b648-b5524aa575b5","Type":"ContainerDied","Data":"33719a3dec98db29e973ad44acdbb1229e216a50ac8a17b7ec8a1c462ff90c1f"}
Oct 30 22:35:01.253177 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.253154    5258 scope.go:122] "RemoveContainer" containerID="4afc0191771c604ae4f42369e46a2cdbe8973bd1ce214e50143877b79c5e57d3"
Oct 30 22:35:01.254933 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.254914    5258 generic.go:356] "Generic (PLEG): container finished" podID="c3982e61-9743-45e3-936e-826d18355971" containerID="8faeb63196ef9e327826f685e5dc9cee7f462948e03dbcd2d18c74e8d385a622" exitCode=0
Oct 30 22:35:01.255027 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.255000    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t" event={"ID":"c3982e61-9743-45e3-936e-826d18355971","Type":"ContainerDied","Data":"8faeb63196ef9e327826f685e5dc9cee7f462948e03dbcd2d18c74e8d385a622"}
Oct 30 22:35:01.255464 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.255442    5258 scope.go:122] "RemoveContainer" containerID="8faeb63196ef9e327826f685e5dc9cee7f462948e03dbcd2d18c74e8d385a622"
Oct 30 22:35:01.257156 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.257122    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:35:01.257237 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.257216    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:35:01.257278 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.257263    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:35:01.267375 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.267355    5258 scope.go:122] "RemoveContainer" containerID="4afc0191771c604ae4f42369e46a2cdbe8973bd1ce214e50143877b79c5e57d3"
Oct 30 22:35:01.267680 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:35:01.267660    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4afc0191771c604ae4f42369e46a2cdbe8973bd1ce214e50143877b79c5e57d3\": container with ID starting with 4afc0191771c604ae4f42369e46a2cdbe8973bd1ce214e50143877b79c5e57d3 not found: ID does not exist" containerID="4afc0191771c604ae4f42369e46a2cdbe8973bd1ce214e50143877b79c5e57d3"
Oct 30 22:35:01.267770 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.267687    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4afc0191771c604ae4f42369e46a2cdbe8973bd1ce214e50143877b79c5e57d3"} err="failed to get container status \"4afc0191771c604ae4f42369e46a2cdbe8973bd1ce214e50143877b79c5e57d3\": rpc error: code = NotFound desc = could not find container \"4afc0191771c604ae4f42369e46a2cdbe8973bd1ce214e50143877b79c5e57d3\": container with ID starting with 4afc0191771c604ae4f42369e46a2cdbe8973bd1ce214e50143877b79c5e57d3 not found: ID does not exist"
Oct 30 22:35:01.419895 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.419862    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"]
Oct 30 22:35:01.431122 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:01.431092    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-075cbb/simulator-w5-075cbb-kserve-74d46db6cf-922nk"]
Oct 30 22:35:02.285297 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:02.285260    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t" event={"ID":"c3982e61-9743-45e3-936e-826d18355971","Type":"ContainerStarted","Data":"fce4907d2b21686c3db6fbc699264dd0848a1c12349337ac0381fcdab5aedfef"}
Oct 30 22:35:02.533453 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:02.533402    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:35:03.017681 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:03.017637    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:35:03.019169 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:03.019139    5258 patch_prober.go:29] interesting pod/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 22:35:03.019327 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:03.019184    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t" podUID="c3982e61-9743-45e3-936e-826d18355971" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 22:35:03.387361 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:03.387323    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" path="/var/lib/kubelet/pods/fa100c4d-158f-4995-b648-b5524aa575b5/volumes"
Oct 30 22:35:04.018326 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:04.018285    5258 patch_prober.go:29] interesting pod/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 22:35:04.018544 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:04.018364    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t" podUID="c3982e61-9743-45e3-936e-826d18355971" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 22:35:05.018088 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:05.018053    5258 patch_prober.go:29] interesting pod/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 22:35:05.018503 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:05.018112    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t" podUID="c3982e61-9743-45e3-936e-826d18355971" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 22:35:06.017622 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:06.017572    5258 patch_prober.go:29] interesting pod/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 22:35:06.017806 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:06.017665    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t" podUID="c3982e61-9743-45e3-936e-826d18355971" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 22:35:06.366442 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:06.366407    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:06.939822 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:06.939767    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:07.017316 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:07.017281    5258 patch_prober.go:29] interesting pod/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 22:35:07.017500 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:07.017343    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t" podUID="c3982e61-9743-45e3-936e-826d18355971" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 22:35:08.021880 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:08.021851    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:35:08.023074 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:08.023050    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:35:08.483692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:08.483649    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj" podUID="2ddb2f4d-1a6e-4b97-bada-6997a01536d1" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:35:11.853712 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:11.853674    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:13.162046 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:35:13.162000    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:35:14.889533 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:14.889488    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:35:16.347494 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:16.347450    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:16.853713 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:16.853660    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:16.900626 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:16.899514    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"
Oct 30 22:35:16.955562 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:16.955459    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ddb2f4d-1a6e-4b97-bada-6997a01536d1-kube-api-access-fnfpx\" (UniqueName: \"kubernetes.io/projected/2ddb2f4d-1a6e-4b97-bada-6997a01536d1-kube-api-access-fnfpx\") pod \"2ddb2f4d-1a6e-4b97-bada-6997a01536d1\" (UID: \"2ddb2f4d-1a6e-4b97-bada-6997a01536d1\") "
Oct 30 22:35:16.955839 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:16.955643    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2ddb2f4d-1a6e-4b97-bada-6997a01536d1-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ddb2f4d-1a6e-4b97-bada-6997a01536d1-plugins-config-volume\") pod \"2ddb2f4d-1a6e-4b97-bada-6997a01536d1\" (UID: \"2ddb2f4d-1a6e-4b97-bada-6997a01536d1\") "
Oct 30 22:35:16.956486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:16.956461    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ddb2f4d-1a6e-4b97-bada-6997a01536d1-plugins-config-volume" pod "2ddb2f4d-1a6e-4b97-bada-6997a01536d1" (UID: "2ddb2f4d-1a6e-4b97-bada-6997a01536d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:35:16.959772 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:16.959732    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ddb2f4d-1a6e-4b97-bada-6997a01536d1-kube-api-access-fnfpx" pod "2ddb2f4d-1a6e-4b97-bada-6997a01536d1" (UID: "2ddb2f4d-1a6e-4b97-bada-6997a01536d1"). InnerVolumeSpecName "kube-api-access-fnfpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:17.057237 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:17.057199    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnfpx\" (UniqueName: \"kubernetes.io/projected/2ddb2f4d-1a6e-4b97-bada-6997a01536d1-kube-api-access-fnfpx\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:17.057237 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:17.057234    5258 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ddb2f4d-1a6e-4b97-bada-6997a01536d1-plugins-config-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:17.406613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:17.406438    5258 generic.go:356] "Generic (PLEG): container finished" podID="2ddb2f4d-1a6e-4b97-bada-6997a01536d1" containerID="f4aa2f49f508204679a5d8324906e07a0c649e87c9da39309c234e089d1d7b8e" exitCode=0
Oct 30 22:35:17.407136 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:17.406632    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"
Oct 30 22:35:17.437835 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:17.435886    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj" event={"ID":"2ddb2f4d-1a6e-4b97-bada-6997a01536d1","Type":"ContainerDied","Data":"f4aa2f49f508204679a5d8324906e07a0c649e87c9da39309c234e089d1d7b8e"}
Oct 30 22:35:17.437835 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:17.435928    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj" event={"ID":"2ddb2f4d-1a6e-4b97-bada-6997a01536d1","Type":"ContainerDied","Data":"6e044168ed23c424405aa94aa934070303f53bdaf91af437f027d05b565cc5c9"}
Oct 30 22:35:17.437835 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:17.435953    5258 scope.go:122] "RemoveContainer" containerID="f4aa2f49f508204679a5d8324906e07a0c649e87c9da39309c234e089d1d7b8e"
Oct 30 22:35:17.488610 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:17.478997    5258 scope.go:122] "RemoveContainer" containerID="f4aa2f49f508204679a5d8324906e07a0c649e87c9da39309c234e089d1d7b8e"
Oct 30 22:35:17.488610 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:35:17.479360    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4aa2f49f508204679a5d8324906e07a0c649e87c9da39309c234e089d1d7b8e\": container with ID starting with f4aa2f49f508204679a5d8324906e07a0c649e87c9da39309c234e089d1d7b8e not found: ID does not exist" containerID="f4aa2f49f508204679a5d8324906e07a0c649e87c9da39309c234e089d1d7b8e"
Oct 30 22:35:17.488610 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:17.479396    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4aa2f49f508204679a5d8324906e07a0c649e87c9da39309c234e089d1d7b8e"} err="failed to get container status \"f4aa2f49f508204679a5d8324906e07a0c649e87c9da39309c234e089d1d7b8e\": rpc error: code = NotFound desc = could not find container \"f4aa2f49f508204679a5d8324906e07a0c649e87c9da39309c234e089d1d7b8e\": container with ID starting with f4aa2f49f508204679a5d8324906e07a0c649e87c9da39309c234e089d1d7b8e not found: ID does not exist"
Oct 30 22:35:17.648455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:17.648406    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"]
Oct 30 22:35:17.694971 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:17.694863    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w5-075cbb-8dd7f5f8c-rjgsj"]
Oct 30 22:35:19.382649 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:19.382614    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ddb2f4d-1a6e-4b97-bada-6997a01536d1" path="/var/lib/kubelet/pods/2ddb2f4d-1a6e-4b97-bada-6997a01536d1/volumes"
Oct 30 22:35:21.903178 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:21.903141    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:22.982359 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:22.982315    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:23.206017 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:23.205977    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:25.766729 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:25.766631    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:27.004707 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:27.004666    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:27.366486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:27.366445    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:29.559850 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:29.559799    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:32.129356 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:32.129316    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:32.614531 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:32.614497    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:37.148247 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:37.148203    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:41.552323 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:41.552285    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:42.541440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:42.541407    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:43.158519 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:43.158428    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:43.162362 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:35:43.162329    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:35:43.406293 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:43.406253    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:43.634576 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:43.634522    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:44.269730 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:44.269695    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:48.773698 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:48.773653    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:50.956048 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:50.956010    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:51.566426 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:51.566384    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:51.866579 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:51.866479    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:51.905650 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:51.905608    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"]
Oct 30 22:35:51.905833 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:51.905816    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv" podUID="f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" containerName="istio-proxy" containerID="cri-o://ec8b78951ac4858fb5982a11f4a870f9c27a57319e3bdd40b5a5457b97a78039" gracePeriod=30
Oct 30 22:35:52.116345 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:52.116310    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:54.244038 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:54.243997    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:55.434344 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:55.434309    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:55.859071 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:55.859028    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"]
Oct 30 22:35:55.907240 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:55.907199    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"]
Oct 30 22:35:56.104664 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:56.104629    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:57.038649 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.038615    5258 patch_prober.go:29] interesting pod/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 30 22:35:57.039111 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.038667    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv" podUID="f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 30 22:35:57.183059 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.182985    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:35:57.320245 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.320203    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-credential-socket\") pod \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") "
Oct 30 22:35:57.320245 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.320250    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-workload-socket\") pod \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") "
Oct 30 22:35:57.320515 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.320275    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-kube-api-access-ldq4p\" (UniqueName: \"kubernetes.io/projected/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-kube-api-access-ldq4p\") pod \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") "
Oct 30 22:35:57.320515 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.320388    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-token\" (UniqueName: \"kubernetes.io/projected/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-token\") pod \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") "
Oct 30 22:35:57.320515 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.320420    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-workload-certs\") pod \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") "
Oct 30 22:35:57.320515 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.320468    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istiod-ca-cert\") pod \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") "
Oct 30 22:35:57.320763 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.320529    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-data\") pod \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") "
Oct 30 22:35:57.320763 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.320541    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-workload-socket" pod "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" (UID: "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:57.320763 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.320576    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-podinfo\") pod \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") "
Oct 30 22:35:57.320763 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.320621    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-credential-socket" pod "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" (UID: "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:57.320763 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.320698    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-envoy\") pod \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\" (UID: \"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c\") "
Oct 30 22:35:57.321041 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.320843    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-workload-certs" pod "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" (UID: "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:57.321199 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.321168    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istiod-ca-cert" pod "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" (UID: "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:35:57.321327 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.321217    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:57.321327 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.321240    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:57.321327 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.321255    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:57.321507 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.321382    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-data" pod "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" (UID: "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:57.323463 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.323436    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-kube-api-access-ldq4p" pod "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" (UID: "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c"). InnerVolumeSpecName "kube-api-access-ldq4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:57.323583 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.323440    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-podinfo" pod "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" (UID: "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:35:57.323992 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.323966    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-envoy" pod "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" (UID: "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:57.324647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.324627    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-token" pod "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" (UID: "f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:57.422116 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.422069    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:57.422116 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.422110    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:57.422340 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.422125    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:57.422340 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.422138    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:57.422340 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.422151    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:57.422340 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.422163    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldq4p\" (UniqueName: \"kubernetes.io/projected/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c-kube-api-access-ldq4p\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:57.694976 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.694932    5258 generic.go:356] "Generic (PLEG): container finished" podID="f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" containerID="ec8b78951ac4858fb5982a11f4a870f9c27a57319e3bdd40b5a5457b97a78039" exitCode=0
Oct 30 22:35:57.695290 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.695009    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv" event={"ID":"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c","Type":"ContainerDied","Data":"ec8b78951ac4858fb5982a11f4a870f9c27a57319e3bdd40b5a5457b97a78039"}
Oct 30 22:35:57.695290 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.695076    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv" event={"ID":"f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c","Type":"ContainerDied","Data":"3af1d5072b37d89707117a021665e06c15de366a44b953560e9558ce2f2b6638"}
Oct 30 22:35:57.695290 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.695021    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"
Oct 30 22:35:57.695290 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.695108    5258 scope.go:122] "RemoveContainer" containerID="ec8b78951ac4858fb5982a11f4a870f9c27a57319e3bdd40b5a5457b97a78039"
Oct 30 22:35:57.708782 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.708753    5258 scope.go:122] "RemoveContainer" containerID="ec8b78951ac4858fb5982a11f4a870f9c27a57319e3bdd40b5a5457b97a78039"
Oct 30 22:35:57.709760 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:35:57.709724    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec8b78951ac4858fb5982a11f4a870f9c27a57319e3bdd40b5a5457b97a78039\": container with ID starting with ec8b78951ac4858fb5982a11f4a870f9c27a57319e3bdd40b5a5457b97a78039 not found: ID does not exist" containerID="ec8b78951ac4858fb5982a11f4a870f9c27a57319e3bdd40b5a5457b97a78039"
Oct 30 22:35:57.709887 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.709767    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec8b78951ac4858fb5982a11f4a870f9c27a57319e3bdd40b5a5457b97a78039"} err="failed to get container status \"ec8b78951ac4858fb5982a11f4a870f9c27a57319e3bdd40b5a5457b97a78039\": rpc error: code = NotFound desc = could not find container \"ec8b78951ac4858fb5982a11f4a870f9c27a57319e3bdd40b5a5457b97a78039\": container with ID starting with ec8b78951ac4858fb5982a11f4a870f9c27a57319e3bdd40b5a5457b97a78039 not found: ID does not exist"
Oct 30 22:35:57.864559 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.864519    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"]
Oct 30 22:35:57.912302 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:57.912265    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-075cbb-openshift-default-655db97969-swntv"]
Oct 30 22:35:58.996950 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:58.996914    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:35:59.382447 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:59.382408    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" path="/var/lib/kubelet/pods/f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c/volumes"
Oct 30 22:35:59.501245 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:35:59.501209    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:02.354548 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:02.354503    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"]
Oct 30 22:36:02.823827 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:02.823791    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:03.174149 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:03.174056    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:04.752936 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:04.752906    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:07.355532 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:07.355494    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88" podUID="b7de5d2b-2183-4fce-bff9-3e18fce386e2" containerName="payload-processing" containerID="cri-o://86083c224a4c8029922d346fe56aee2ee3d0d36ee1cb9c1e2ce4f4be6418d10e" gracePeriod=25
Oct 30 22:36:09.824578 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:09.824536    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:10.874188 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:10.874151    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:10.880603 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:10.880570    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main" containerID="cri-o://25ca6fc8e023b87158baf4ad5d0a200cc59e50f5b44a113c543929b3596159b2" gracePeriod=45
Oct 30 22:36:10.927332 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:10.927302    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" containerID="cri-o://0c4a441e0db8b8469331c946736b99f39433a0afe6ae222e302e560b59a869b9" gracePeriod=45
Oct 30 22:36:10.930864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:10.930838    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": dial tcp 10.132.0.76:8000: connect: connection refused"
Oct 30 22:36:10.985004 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:10.984745    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main" probeResult="failure" output="Get \"https://10.132.0.89:8000/ready\": dial tcp 10.132.0.89:8000: connect: connection refused"
Oct 30 22:36:11.143206 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.143105    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:11.207730 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.207707    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:36:11.210972 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.210949    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:36:11.279512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.279484    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-tmp-dir\") pod \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") "
Oct 30 22:36:11.279650 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.279539    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-dshm\") pod \"39c00f4f-9fae-4aac-acf3-335d0055b534\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") "
Oct 30 22:36:11.279650 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.279559    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-model-cache\") pod \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") "
Oct 30 22:36:11.279737 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.279648    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-kube-api-access-rphct\" (UniqueName: \"kubernetes.io/projected/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-kube-api-access-rphct\") pod \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") "
Oct 30 22:36:11.279737 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.279693    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39c00f4f-9fae-4aac-acf3-335d0055b534-kube-api-access-dsl8d\" (UniqueName: \"kubernetes.io/projected/39c00f4f-9fae-4aac-acf3-335d0055b534-kube-api-access-dsl8d\") pod \"39c00f4f-9fae-4aac-acf3-335d0055b534\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") "
Oct 30 22:36:11.279818 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.279746    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-dshm\") pod \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") "
Oct 30 22:36:11.279875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.279832    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-home\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-home\") pod \"39c00f4f-9fae-4aac-acf3-335d0055b534\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") "
Oct 30 22:36:11.279875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.279840    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-tmp-dir" pod "a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" (UID: "a1ab3125-0789-4c58-9b92-fd7f46ed3b0c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:11.279875 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.279867    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-model-cache" pod "a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" (UID: "a1ab3125-0789-4c58-9b92-fd7f46ed3b0c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:11.280037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.279893    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39c00f4f-9fae-4aac-acf3-335d0055b534-tls-certs\" (UniqueName: \"kubernetes.io/secret/39c00f4f-9fae-4aac-acf3-335d0055b534-tls-certs\") pod \"39c00f4f-9fae-4aac-acf3-335d0055b534\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") "
Oct 30 22:36:11.280037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.279931    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-home\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-home\") pod \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") "
Oct 30 22:36:11.280037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.280017    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-tmp-dir\") pod \"39c00f4f-9fae-4aac-acf3-335d0055b534\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") "
Oct 30 22:36:11.280211 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.280065    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-tls-certs\") pod \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\" (UID: \"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c\") "
Oct 30 22:36:11.280211 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.280080    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-home" pod "39c00f4f-9fae-4aac-acf3-335d0055b534" (UID: "39c00f4f-9fae-4aac-acf3-335d0055b534"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:11.280211 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.280106    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-model-cache\") pod \"39c00f4f-9fae-4aac-acf3-335d0055b534\" (UID: \"39c00f4f-9fae-4aac-acf3-335d0055b534\") "
Oct 30 22:36:11.280369 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.280270    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-home" pod "a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" (UID: "a1ab3125-0789-4c58-9b92-fd7f46ed3b0c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:11.280466 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.280439    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-tmp-dir" pod "39c00f4f-9fae-4aac-acf3-335d0055b534" (UID: "39c00f4f-9fae-4aac-acf3-335d0055b534"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:11.280711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.280645    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-model-cache" pod "39c00f4f-9fae-4aac-acf3-335d0055b534" (UID: "39c00f4f-9fae-4aac-acf3-335d0055b534"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:11.280711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.280695    5258 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-tmp-dir\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.280919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.280719    5258 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-tmp-dir\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.280919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.280734    5258 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-model-cache\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.280919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.280750    5258 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-home\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.280919 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.280763    5258 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-home\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.282218 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.282195    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-kube-api-access-rphct" pod "a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" (UID: "a1ab3125-0789-4c58-9b92-fd7f46ed3b0c"). InnerVolumeSpecName "kube-api-access-rphct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:11.282334 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.282312    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39c00f4f-9fae-4aac-acf3-335d0055b534-kube-api-access-dsl8d" pod "39c00f4f-9fae-4aac-acf3-335d0055b534" (UID: "39c00f4f-9fae-4aac-acf3-335d0055b534"). InnerVolumeSpecName "kube-api-access-dsl8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:11.282418 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.282334    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-dshm" pod "39c00f4f-9fae-4aac-acf3-335d0055b534" (UID: "39c00f4f-9fae-4aac-acf3-335d0055b534"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:11.282418 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.282346    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-tls-certs" pod "a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" (UID: "a1ab3125-0789-4c58-9b92-fd7f46ed3b0c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:36:11.282553 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.282533    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39c00f4f-9fae-4aac-acf3-335d0055b534-tls-certs" pod "39c00f4f-9fae-4aac-acf3-335d0055b534" (UID: "39c00f4f-9fae-4aac-acf3-335d0055b534"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:36:11.282745 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.282729    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-dshm" pod "a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" (UID: "a1ab3125-0789-4c58-9b92-fd7f46ed3b0c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:11.360990 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.360945    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:11.381468 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.381436    5258 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-tls-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.381468 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.381466    5258 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-model-cache\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.381468 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.381476    5258 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c00f4f-9fae-4aac-acf3-335d0055b534-dshm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.381731 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.381486    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rphct\" (UniqueName: \"kubernetes.io/projected/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-kube-api-access-rphct\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.381731 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.381496    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsl8d\" (UniqueName: \"kubernetes.io/projected/39c00f4f-9fae-4aac-acf3-335d0055b534-kube-api-access-dsl8d\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.381731 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.381504    5258 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c-dshm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.381731 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.381512    5258 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c00f4f-9fae-4aac-acf3-335d0055b534-tls-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.415535 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.415506    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88" podUID="b7de5d2b-2183-4fce-bff9-3e18fce386e2" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:36:11.802477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.802388    5258 generic.go:356] "Generic (PLEG): container finished" podID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerID="25ca6fc8e023b87158baf4ad5d0a200cc59e50f5b44a113c543929b3596159b2" exitCode=0
Oct 30 22:36:11.802477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.802451    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"
Oct 30 22:36:11.802721 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.802474    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" event={"ID":"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c","Type":"ContainerDied","Data":"25ca6fc8e023b87158baf4ad5d0a200cc59e50f5b44a113c543929b3596159b2"}
Oct 30 22:36:11.802721 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.802517    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4" event={"ID":"a1ab3125-0789-4c58-9b92-fd7f46ed3b0c","Type":"ContainerDied","Data":"444c116fed053c7fd15e690f8e18384f6fddae3a083bdb78f2cd38321dc3bc1d"}
Oct 30 22:36:11.802721 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.802539    5258 scope.go:122] "RemoveContainer" containerID="25ca6fc8e023b87158baf4ad5d0a200cc59e50f5b44a113c543929b3596159b2"
Oct 30 22:36:11.804176 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.804151    5258 generic.go:356] "Generic (PLEG): container finished" podID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerID="0c4a441e0db8b8469331c946736b99f39433a0afe6ae222e302e560b59a869b9" exitCode=0
Oct 30 22:36:11.804295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.804204    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"
Oct 30 22:36:11.804295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.804224    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" event={"ID":"39c00f4f-9fae-4aac-acf3-335d0055b534","Type":"ContainerDied","Data":"0c4a441e0db8b8469331c946736b99f39433a0afe6ae222e302e560b59a869b9"}
Oct 30 22:36:11.804295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.804258    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9" event={"ID":"39c00f4f-9fae-4aac-acf3-335d0055b534","Type":"ContainerDied","Data":"ba2dceb3cf0a81fb59fe31727c3c9bc53264343dfe59071ac85bcf7419ca61f5"}
Oct 30 22:36:11.812750 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.812723    5258 scope.go:122] "RemoveContainer" containerID="25ca6fc8e023b87158baf4ad5d0a200cc59e50f5b44a113c543929b3596159b2"
Oct 30 22:36:11.812989 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:36:11.812971    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25ca6fc8e023b87158baf4ad5d0a200cc59e50f5b44a113c543929b3596159b2\": container with ID starting with 25ca6fc8e023b87158baf4ad5d0a200cc59e50f5b44a113c543929b3596159b2 not found: ID does not exist" containerID="25ca6fc8e023b87158baf4ad5d0a200cc59e50f5b44a113c543929b3596159b2"
Oct 30 22:36:11.813041 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.812996    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25ca6fc8e023b87158baf4ad5d0a200cc59e50f5b44a113c543929b3596159b2"} err="failed to get container status \"25ca6fc8e023b87158baf4ad5d0a200cc59e50f5b44a113c543929b3596159b2\": rpc error: code = NotFound desc = could not find container \"25ca6fc8e023b87158baf4ad5d0a200cc59e50f5b44a113c543929b3596159b2\": container with ID starting with 25ca6fc8e023b87158baf4ad5d0a200cc59e50f5b44a113c543929b3596159b2 not found: ID does not exist"
Oct 30 22:36:11.813041 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.813012    5258 scope.go:122] "RemoveContainer" containerID="0c4a441e0db8b8469331c946736b99f39433a0afe6ae222e302e560b59a869b9"
Oct 30 22:36:11.821669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.821653    5258 scope.go:122] "RemoveContainer" containerID="0c4a441e0db8b8469331c946736b99f39433a0afe6ae222e302e560b59a869b9"
Oct 30 22:36:11.821929 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:36:11.821909    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c4a441e0db8b8469331c946736b99f39433a0afe6ae222e302e560b59a869b9\": container with ID starting with 0c4a441e0db8b8469331c946736b99f39433a0afe6ae222e302e560b59a869b9 not found: ID does not exist" containerID="0c4a441e0db8b8469331c946736b99f39433a0afe6ae222e302e560b59a869b9"
Oct 30 22:36:11.821978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.821936    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c4a441e0db8b8469331c946736b99f39433a0afe6ae222e302e560b59a869b9"} err="failed to get container status \"0c4a441e0db8b8469331c946736b99f39433a0afe6ae222e302e560b59a869b9\": rpc error: code = NotFound desc = could not find container \"0c4a441e0db8b8469331c946736b99f39433a0afe6ae222e302e560b59a869b9\": container with ID starting with 0c4a441e0db8b8469331c946736b99f39433a0afe6ae222e302e560b59a869b9 not found: ID does not exist"
Oct 30 22:36:11.969390 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.969361    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"]
Oct 30 22:36:11.983777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:11.983755    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-2a4123/distinct-2-w0-2a4123-kserve-cffcbf55-74tc4"]
Oct 30 22:36:12.083617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:12.083573    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"]
Oct 30 22:36:12.090884 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:12.090857    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-2a4123/premium-w0-2a4123-kserve-5d84665997-ql2s9"]
Oct 30 22:36:13.160304 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:36:13.160267    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:36:13.381646 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:13.381616    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" path="/var/lib/kubelet/pods/39c00f4f-9fae-4aac-acf3-335d0055b534/volumes"
Oct 30 22:36:13.382064 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:13.382050    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" path="/var/lib/kubelet/pods/a1ab3125-0789-4c58-9b92-fd7f46ed3b0c/volumes"
Oct 30 22:36:15.196494 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:15.196449    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:15.775802 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:15.775761    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"]
Oct 30 22:36:15.823490 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:15.823456    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"]
Oct 30 22:36:16.111746 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:16.111710    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:18.331041 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:18.331005    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:18.603174 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:18.603078    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:20.403615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:20.400325    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:21.417221 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:21.417186    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88" podUID="b7de5d2b-2183-4fce-bff9-3e18fce386e2" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:36:23.038985 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:23.038951    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"]
Oct 30 22:36:23.384841 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:23.384798    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:23.632924 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:23.632888    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:25.600091 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:25.600059    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:27.619425 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:27.619354    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"
Oct 30 22:36:27.737437 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:27.737403    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7de5d2b-2183-4fce-bff9-3e18fce386e2-kube-api-access-kfjdx\" (UniqueName: \"kubernetes.io/projected/b7de5d2b-2183-4fce-bff9-3e18fce386e2-kube-api-access-kfjdx\") pod \"b7de5d2b-2183-4fce-bff9-3e18fce386e2\" (UID: \"b7de5d2b-2183-4fce-bff9-3e18fce386e2\") "
Oct 30 22:36:27.737651 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:27.737546    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b7de5d2b-2183-4fce-bff9-3e18fce386e2-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7de5d2b-2183-4fce-bff9-3e18fce386e2-plugins-config-volume\") pod \"b7de5d2b-2183-4fce-bff9-3e18fce386e2\" (UID: \"b7de5d2b-2183-4fce-bff9-3e18fce386e2\") "
Oct 30 22:36:27.738040 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:27.737986    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7de5d2b-2183-4fce-bff9-3e18fce386e2-plugins-config-volume" pod "b7de5d2b-2183-4fce-bff9-3e18fce386e2" (UID: "b7de5d2b-2183-4fce-bff9-3e18fce386e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:36:27.740149 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:27.740116    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7de5d2b-2183-4fce-bff9-3e18fce386e2-kube-api-access-kfjdx" pod "b7de5d2b-2183-4fce-bff9-3e18fce386e2" (UID: "b7de5d2b-2183-4fce-bff9-3e18fce386e2"). InnerVolumeSpecName "kube-api-access-kfjdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:27.838713 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:27.838679    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfjdx\" (UniqueName: \"kubernetes.io/projected/b7de5d2b-2183-4fce-bff9-3e18fce386e2-kube-api-access-kfjdx\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:27.838713 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:27.838709    5258 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7de5d2b-2183-4fce-bff9-3e18fce386e2-plugins-config-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:27.960713 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:27.960619    5258 generic.go:356] "Generic (PLEG): container finished" podID="b7de5d2b-2183-4fce-bff9-3e18fce386e2" containerID="86083c224a4c8029922d346fe56aee2ee3d0d36ee1cb9c1e2ce4f4be6418d10e" exitCode=0
Oct 30 22:36:27.960713 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:27.960654    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88" event={"ID":"b7de5d2b-2183-4fce-bff9-3e18fce386e2","Type":"ContainerDied","Data":"86083c224a4c8029922d346fe56aee2ee3d0d36ee1cb9c1e2ce4f4be6418d10e"}
Oct 30 22:36:27.960713 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:27.960683    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"
Oct 30 22:36:27.960713 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:27.960712    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88" event={"ID":"b7de5d2b-2183-4fce-bff9-3e18fce386e2","Type":"ContainerDied","Data":"6b69f690f1be01098cdd029d8168ee79b32acaf64b96d6de9bd7986fc35d9421"}
Oct 30 22:36:27.961054 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:27.960737    5258 scope.go:122] "RemoveContainer" containerID="86083c224a4c8029922d346fe56aee2ee3d0d36ee1cb9c1e2ce4f4be6418d10e"
Oct 30 22:36:27.971967 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:27.971948    5258 scope.go:122] "RemoveContainer" containerID="86083c224a4c8029922d346fe56aee2ee3d0d36ee1cb9c1e2ce4f4be6418d10e"
Oct 30 22:36:27.972248 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:36:27.972229    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86083c224a4c8029922d346fe56aee2ee3d0d36ee1cb9c1e2ce4f4be6418d10e\": container with ID starting with 86083c224a4c8029922d346fe56aee2ee3d0d36ee1cb9c1e2ce4f4be6418d10e not found: ID does not exist" containerID="86083c224a4c8029922d346fe56aee2ee3d0d36ee1cb9c1e2ce4f4be6418d10e"
Oct 30 22:36:27.972300 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:27.972259    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86083c224a4c8029922d346fe56aee2ee3d0d36ee1cb9c1e2ce4f4be6418d10e"} err="failed to get container status \"86083c224a4c8029922d346fe56aee2ee3d0d36ee1cb9c1e2ce4f4be6418d10e\": rpc error: code = NotFound desc = could not find container \"86083c224a4c8029922d346fe56aee2ee3d0d36ee1cb9c1e2ce4f4be6418d10e\": container with ID starting with 86083c224a4c8029922d346fe56aee2ee3d0d36ee1cb9c1e2ce4f4be6418d10e not found: ID does not exist"
Oct 30 22:36:28.039728 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.039687    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj" podUID="8891fbb0-53aa-451f-8971-e20fb5db3ddd" containerName="payload-pre-processing" containerID="cri-o://5712df38ff016b222c948c42326f30d33474832a96e77fe005ff189b5f782339" gracePeriod=25
Oct 30 22:36:28.128392 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.128353    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"]
Oct 30 22:36:28.134106 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.134079    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-2a4123-74b7799fc7-tjr88"]
Oct 30 22:36:28.286681 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.286654    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"
Oct 30 22:36:28.445342 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.445304    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8891fbb0-53aa-451f-8971-e20fb5db3ddd-kube-api-access-2jz8p\" (UniqueName: \"kubernetes.io/projected/8891fbb0-53aa-451f-8971-e20fb5db3ddd-kube-api-access-2jz8p\") pod \"8891fbb0-53aa-451f-8971-e20fb5db3ddd\" (UID: \"8891fbb0-53aa-451f-8971-e20fb5db3ddd\") "
Oct 30 22:36:28.445548 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.445375    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8891fbb0-53aa-451f-8971-e20fb5db3ddd-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8891fbb0-53aa-451f-8971-e20fb5db3ddd-plugins-config-volume\") pod \"8891fbb0-53aa-451f-8971-e20fb5db3ddd\" (UID: \"8891fbb0-53aa-451f-8971-e20fb5db3ddd\") "
Oct 30 22:36:28.445910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.445876    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8891fbb0-53aa-451f-8971-e20fb5db3ddd-plugins-config-volume" pod "8891fbb0-53aa-451f-8971-e20fb5db3ddd" (UID: "8891fbb0-53aa-451f-8971-e20fb5db3ddd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:36:28.447543 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.447513    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8891fbb0-53aa-451f-8971-e20fb5db3ddd-kube-api-access-2jz8p" pod "8891fbb0-53aa-451f-8971-e20fb5db3ddd" (UID: "8891fbb0-53aa-451f-8971-e20fb5db3ddd"). InnerVolumeSpecName "kube-api-access-2jz8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:28.547316 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.547227    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jz8p\" (UniqueName: \"kubernetes.io/projected/8891fbb0-53aa-451f-8971-e20fb5db3ddd-kube-api-access-2jz8p\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:28.547316 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.547265    5258 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8891fbb0-53aa-451f-8971-e20fb5db3ddd-plugins-config-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:28.970050 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.970006    5258 generic.go:356] "Generic (PLEG): container finished" podID="8891fbb0-53aa-451f-8971-e20fb5db3ddd" containerID="5712df38ff016b222c948c42326f30d33474832a96e77fe005ff189b5f782339" exitCode=0
Oct 30 22:36:28.970641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.970063    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"
Oct 30 22:36:28.970641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.970078    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj" event={"ID":"8891fbb0-53aa-451f-8971-e20fb5db3ddd","Type":"ContainerDied","Data":"5712df38ff016b222c948c42326f30d33474832a96e77fe005ff189b5f782339"}
Oct 30 22:36:28.970641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.970141    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj" event={"ID":"8891fbb0-53aa-451f-8971-e20fb5db3ddd","Type":"ContainerDied","Data":"8ce9ccdcd6e4ce6cb785dee788ea8baf3b52990ba93f1f231344ec880b6eb24b"}
Oct 30 22:36:28.970641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.970171    5258 scope.go:122] "RemoveContainer" containerID="5712df38ff016b222c948c42326f30d33474832a96e77fe005ff189b5f782339"
Oct 30 22:36:28.980762 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.980735    5258 scope.go:122] "RemoveContainer" containerID="5712df38ff016b222c948c42326f30d33474832a96e77fe005ff189b5f782339"
Oct 30 22:36:28.981065 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:36:28.981043    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5712df38ff016b222c948c42326f30d33474832a96e77fe005ff189b5f782339\": container with ID starting with 5712df38ff016b222c948c42326f30d33474832a96e77fe005ff189b5f782339 not found: ID does not exist" containerID="5712df38ff016b222c948c42326f30d33474832a96e77fe005ff189b5f782339"
Oct 30 22:36:28.981138 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:28.981074    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5712df38ff016b222c948c42326f30d33474832a96e77fe005ff189b5f782339"} err="failed to get container status \"5712df38ff016b222c948c42326f30d33474832a96e77fe005ff189b5f782339\": rpc error: code = NotFound desc = could not find container \"5712df38ff016b222c948c42326f30d33474832a96e77fe005ff189b5f782339\": container with ID starting with 5712df38ff016b222c948c42326f30d33474832a96e77fe005ff189b5f782339 not found: ID does not exist"
Oct 30 22:36:29.136286 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:29.136254    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"]
Oct 30 22:36:29.141617 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:29.141574    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-97aa64-5d87b8cd99-fmptj"]
Oct 30 22:36:29.390131 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:29.390095    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8891fbb0-53aa-451f-8971-e20fb5db3ddd" path="/var/lib/kubelet/pods/8891fbb0-53aa-451f-8971-e20fb5db3ddd/volumes"
Oct 30 22:36:29.390679 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:29.390661    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b7de5d2b-2183-4fce-bff9-3e18fce386e2" path="/var/lib/kubelet/pods/b7de5d2b-2183-4fce-bff9-3e18fce386e2/volumes"
Oct 30 22:36:29.890230 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:29.890192    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:30.797747 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:30.797706    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main" containerID="cri-o://96a7fb740392674d78f455dbb02c52d045ec35cbd4ed4306642ad1b5b9df0478" gracePeriod=45
Oct 30 22:36:30.843323 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:30.843290    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main" containerID="cri-o://5c8cd0c796456dd0429bae2197c43de5ca77cdc600f1108e1473145757921cfd" gracePeriod=45
Oct 30 22:36:30.987934 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:30.987748    5258 generic.go:356] "Generic (PLEG): container finished" podID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerID="5c8cd0c796456dd0429bae2197c43de5ca77cdc600f1108e1473145757921cfd" exitCode=0
Oct 30 22:36:30.987934 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:30.987823    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" event={"ID":"8b2b24d4-20da-4f1d-b968-c11031f364c4","Type":"ContainerDied","Data":"5c8cd0c796456dd0429bae2197c43de5ca77cdc600f1108e1473145757921cfd"}
Oct 30 22:36:30.989423 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:30.989387    5258 generic.go:356] "Generic (PLEG): container finished" podID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerID="96a7fb740392674d78f455dbb02c52d045ec35cbd4ed4306642ad1b5b9df0478" exitCode=0
Oct 30 22:36:30.989569 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:30.989518    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" event={"ID":"691a53b3-2708-4de9-b5c5-e0a7b322e899","Type":"ContainerDied","Data":"96a7fb740392674d78f455dbb02c52d045ec35cbd4ed4306642ad1b5b9df0478"}
Oct 30 22:36:31.070119 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.070090    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:31.128018 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.127989    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:36:31.166660 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.166635    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:36:31.173962 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.173940    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-home\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-home\") pod \"691a53b3-2708-4de9-b5c5-e0a7b322e899\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") "
Oct 30 22:36:31.174083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.173998    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-tmp-dir\") pod \"8b2b24d4-20da-4f1d-b968-c11031f364c4\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") "
Oct 30 22:36:31.174083 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174037    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-dshm\") pod \"8b2b24d4-20da-4f1d-b968-c11031f364c4\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") "
Oct 30 22:36:31.174211 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174102    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-model-cache\") pod \"8b2b24d4-20da-4f1d-b968-c11031f364c4\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") "
Oct 30 22:36:31.174211 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174198    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-tmp-dir\") pod \"691a53b3-2708-4de9-b5c5-e0a7b322e899\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") "
Oct 30 22:36:31.174317 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174209    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-tmp-dir" pod "8b2b24d4-20da-4f1d-b968-c11031f364c4" (UID: "8b2b24d4-20da-4f1d-b968-c11031f364c4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:31.174317 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174223    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-home" pod "691a53b3-2708-4de9-b5c5-e0a7b322e899" (UID: "691a53b3-2708-4de9-b5c5-e0a7b322e899"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:31.174317 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174229    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b2b24d4-20da-4f1d-b968-c11031f364c4-kube-api-access-kz5t8\" (UniqueName: \"kubernetes.io/projected/8b2b24d4-20da-4f1d-b968-c11031f364c4-kube-api-access-kz5t8\") pod \"8b2b24d4-20da-4f1d-b968-c11031f364c4\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") "
Oct 30 22:36:31.174317 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174291    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-home\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-home\") pod \"8b2b24d4-20da-4f1d-b968-c11031f364c4\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") "
Oct 30 22:36:31.174530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174368    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/691a53b3-2708-4de9-b5c5-e0a7b322e899-tls-certs\" (UniqueName: \"kubernetes.io/secret/691a53b3-2708-4de9-b5c5-e0a7b322e899-tls-certs\") pod \"691a53b3-2708-4de9-b5c5-e0a7b322e899\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") "
Oct 30 22:36:31.174530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174402    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-dshm\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-dshm\") pod \"691a53b3-2708-4de9-b5c5-e0a7b322e899\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") "
Oct 30 22:36:31.174530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174399    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-model-cache" pod "8b2b24d4-20da-4f1d-b968-c11031f364c4" (UID: "8b2b24d4-20da-4f1d-b968-c11031f364c4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:31.174530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174412    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-tmp-dir" pod "691a53b3-2708-4de9-b5c5-e0a7b322e899" (UID: "691a53b3-2708-4de9-b5c5-e0a7b322e899"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:31.174530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174445    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-model-cache\") pod \"691a53b3-2708-4de9-b5c5-e0a7b322e899\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") "
Oct 30 22:36:31.174530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174491    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/691a53b3-2708-4de9-b5c5-e0a7b322e899-kube-api-access-w9f5h\" (UniqueName: \"kubernetes.io/projected/691a53b3-2708-4de9-b5c5-e0a7b322e899-kube-api-access-w9f5h\") pod \"691a53b3-2708-4de9-b5c5-e0a7b322e899\" (UID: \"691a53b3-2708-4de9-b5c5-e0a7b322e899\") "
Oct 30 22:36:31.174530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174513    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-home" pod "8b2b24d4-20da-4f1d-b968-c11031f364c4" (UID: "8b2b24d4-20da-4f1d-b968-c11031f364c4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:31.174894 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174560    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8b2b24d4-20da-4f1d-b968-c11031f364c4-tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2b24d4-20da-4f1d-b968-c11031f364c4-tls-certs\") pod \"8b2b24d4-20da-4f1d-b968-c11031f364c4\" (UID: \"8b2b24d4-20da-4f1d-b968-c11031f364c4\") "
Oct 30 22:36:31.174894 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.174701    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-model-cache" pod "691a53b3-2708-4de9-b5c5-e0a7b322e899" (UID: "691a53b3-2708-4de9-b5c5-e0a7b322e899"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:31.175022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.175003    5258 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-model-cache\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:31.175084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.175028    5258 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-tmp-dir\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:31.175084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.175043    5258 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-home\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:31.175084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.175057    5258 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-model-cache\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:31.175084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.175070    5258 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-home\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:31.175242 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.175086    5258 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-tmp-dir\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:31.176604 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.176567    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-dshm" pod "8b2b24d4-20da-4f1d-b968-c11031f364c4" (UID: "8b2b24d4-20da-4f1d-b968-c11031f364c4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:31.176830 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.176809    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b2b24d4-20da-4f1d-b968-c11031f364c4-kube-api-access-kz5t8" pod "8b2b24d4-20da-4f1d-b968-c11031f364c4" (UID: "8b2b24d4-20da-4f1d-b968-c11031f364c4"). InnerVolumeSpecName "kube-api-access-kz5t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:31.176911 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.176804    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/691a53b3-2708-4de9-b5c5-e0a7b322e899-tls-certs" pod "691a53b3-2708-4de9-b5c5-e0a7b322e899" (UID: "691a53b3-2708-4de9-b5c5-e0a7b322e899"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:36:31.177040 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.177019    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-dshm" pod "691a53b3-2708-4de9-b5c5-e0a7b322e899" (UID: "691a53b3-2708-4de9-b5c5-e0a7b322e899"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:31.177081 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.177038    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/691a53b3-2708-4de9-b5c5-e0a7b322e899-kube-api-access-w9f5h" pod "691a53b3-2708-4de9-b5c5-e0a7b322e899" (UID: "691a53b3-2708-4de9-b5c5-e0a7b322e899"). InnerVolumeSpecName "kube-api-access-w9f5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:31.177081 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.177066    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b2b24d4-20da-4f1d-b968-c11031f364c4-tls-certs" pod "8b2b24d4-20da-4f1d-b968-c11031f364c4" (UID: "8b2b24d4-20da-4f1d-b968-c11031f364c4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:36:31.275695 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.275661    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz5t8\" (UniqueName: \"kubernetes.io/projected/8b2b24d4-20da-4f1d-b968-c11031f364c4-kube-api-access-kz5t8\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:31.275695 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.275694    5258 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/691a53b3-2708-4de9-b5c5-e0a7b322e899-tls-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:31.275908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.275707    5258 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/691a53b3-2708-4de9-b5c5-e0a7b322e899-dshm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:31.275908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.275719    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9f5h\" (UniqueName: \"kubernetes.io/projected/691a53b3-2708-4de9-b5c5-e0a7b322e899-kube-api-access-w9f5h\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:31.275908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.275734    5258 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b2b24d4-20da-4f1d-b968-c11031f364c4-tls-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:31.275908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.275748    5258 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b2b24d4-20da-4f1d-b968-c11031f364c4-dshm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:31.997163 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.997129    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"
Oct 30 22:36:31.997163 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.997159    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks" event={"ID":"8b2b24d4-20da-4f1d-b968-c11031f364c4","Type":"ContainerDied","Data":"01aa91dbae2acaff90b521e766a7715b3d0e3a126bdf5220bba7f051d7de8751"}
Oct 30 22:36:31.997736 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.997209    5258 scope.go:122] "RemoveContainer" containerID="5c8cd0c796456dd0429bae2197c43de5ca77cdc600f1108e1473145757921cfd"
Oct 30 22:36:31.998701 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.998684    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"
Oct 30 22:36:31.998784 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:31.998701    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx" event={"ID":"691a53b3-2708-4de9-b5c5-e0a7b322e899","Type":"ContainerDied","Data":"7832370781e4ed7b50f8c6d053d13c35346d97953af727f18ac7d3c321b85f3c"}
Oct 30 22:36:32.007996 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:32.007968    5258 scope.go:122] "RemoveContainer" containerID="96a7fb740392674d78f455dbb02c52d045ec35cbd4ed4306642ad1b5b9df0478"
Oct 30 22:36:32.165261 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:32.165175    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"]
Oct 30 22:36:32.170573 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:32.170544    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-97aa64/distinct-2-w4-97aa64-kserve-596598b778-5kqxx"]
Oct 30 22:36:32.281625 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:32.281579    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"]
Oct 30 22:36:32.287183 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:32.287156    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-97aa64/distinct-w4-97aa64-kserve-77fc7dc957-z5mks"]
Oct 30 22:36:33.380972 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:33.380940    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" path="/var/lib/kubelet/pods/691a53b3-2708-4de9-b5c5-e0a7b322e899/volumes"
Oct 30 22:36:33.381473 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:33.381458    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" path="/var/lib/kubelet/pods/8b2b24d4-20da-4f1d-b968-c11031f364c4/volumes"
Oct 30 22:36:34.619775 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:34.619742    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:34.845797 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:34.845758    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:35.690238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:35.690203    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:36.219986 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:36.219952    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:39.783086 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:39.783034    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:36:41.312323 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:41.312284    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:43.161418 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:36:43.161385    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:36:43.653199 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:43.653159    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:43.872969 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:43.872925    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:46.315833 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:46.315801    5258 scope.go:122] "RemoveContainer" containerID="0ab6870c5313d540c1121e05998c99e2a70feed10e32ed95c0de005f52f4a6ac"
Oct 30 22:36:46.325739 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:46.325635    5258 scope.go:122] "RemoveContainer" containerID="f04d2ed3445a647267e66f4e7c21c1bf0c8ed56dec4e1bda849ff759699e1f86"
Oct 30 22:36:46.334117 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:46.334096    5258 scope.go:122] "RemoveContainer" containerID="6fdfe32f1c49a118c26a05b8191c0bbe92d0e03be91d20c58cc03c3a0e70ac8e"
Oct 30 22:36:46.635780 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:46.635693    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:48.093408 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.093373    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"]
Oct 30 22:36:48.093847 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.093584    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g" podUID="67564d1b-19b9-4e46-9463-f1b4e6e99439" containerName="discovery" containerID="cri-o://6cdaa4216a7c264cdb1692caa6c488d68d6729c322e0498b17885788b78b2d8d" gracePeriod=30
Oct 30 22:36:48.362920 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.362895    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:36:48.451923 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.451893    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-cacerts\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-cacerts\") pod \"67564d1b-19b9-4e46-9463-f1b4e6e99439\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") "
Oct 30 22:36:48.452092 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.451996    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67564d1b-19b9-4e46-9463-f1b4e6e99439-kube-api-access-rlz62\" (UniqueName: \"kubernetes.io/projected/67564d1b-19b9-4e46-9463-f1b4e6e99439-kube-api-access-rlz62\") pod \"67564d1b-19b9-4e46-9463-f1b4e6e99439\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") "
Oct 30 22:36:48.452092 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.452059    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-token\" (UniqueName: \"kubernetes.io/projected/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-token\") pod \"67564d1b-19b9-4e46-9463-f1b4e6e99439\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") "
Oct 30 22:36:48.452163 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.452095    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/67564d1b-19b9-4e46-9463-f1b4e6e99439-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/67564d1b-19b9-4e46-9463-f1b4e6e99439-local-certs\") pod \"67564d1b-19b9-4e46-9463-f1b4e6e99439\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") "
Oct 30 22:36:48.452199 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.452175    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-csr-dns-cert\") pod \"67564d1b-19b9-4e46-9463-f1b4e6e99439\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") "
Oct 30 22:36:48.452233 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.452201    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-kubeconfig\") pod \"67564d1b-19b9-4e46-9463-f1b4e6e99439\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") "
Oct 30 22:36:48.452283 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.452234    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-csr-ca-configmap\") pod \"67564d1b-19b9-4e46-9463-f1b4e6e99439\" (UID: \"67564d1b-19b9-4e46-9463-f1b4e6e99439\") "
Oct 30 22:36:48.452863 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.452805    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-csr-ca-configmap" pod "67564d1b-19b9-4e46-9463-f1b4e6e99439" (UID: "67564d1b-19b9-4e46-9463-f1b4e6e99439"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:36:48.454342 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.454316    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-cacerts" pod "67564d1b-19b9-4e46-9463-f1b4e6e99439" (UID: "67564d1b-19b9-4e46-9463-f1b4e6e99439"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:36:48.454468 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.454348    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-kubeconfig" pod "67564d1b-19b9-4e46-9463-f1b4e6e99439" (UID: "67564d1b-19b9-4e46-9463-f1b4e6e99439"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:36:48.454653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.454628    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67564d1b-19b9-4e46-9463-f1b4e6e99439-local-certs" pod "67564d1b-19b9-4e46-9463-f1b4e6e99439" (UID: "67564d1b-19b9-4e46-9463-f1b4e6e99439"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:48.454653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.454639    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67564d1b-19b9-4e46-9463-f1b4e6e99439-kube-api-access-rlz62" pod "67564d1b-19b9-4e46-9463-f1b4e6e99439" (UID: "67564d1b-19b9-4e46-9463-f1b4e6e99439"). InnerVolumeSpecName "kube-api-access-rlz62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:48.454838 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.454734    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-token" pod "67564d1b-19b9-4e46-9463-f1b4e6e99439" (UID: "67564d1b-19b9-4e46-9463-f1b4e6e99439"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:48.454838 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.454785    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-csr-dns-cert" pod "67564d1b-19b9-4e46-9463-f1b4e6e99439" (UID: "67564d1b-19b9-4e46-9463-f1b4e6e99439"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:36:48.553335 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.553305    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlz62\" (UniqueName: \"kubernetes.io/projected/67564d1b-19b9-4e46-9463-f1b4e6e99439-kube-api-access-rlz62\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:48.553335 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.553332    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:48.553335 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.553343    5258 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/67564d1b-19b9-4e46-9463-f1b4e6e99439-local-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:48.553584 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.553352    5258 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-csr-dns-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:48.553584 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.553362    5258 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-kubeconfig\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:48.553584 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.553370    5258 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/67564d1b-19b9-4e46-9463-f1b4e6e99439-istio-csr-ca-configmap\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:48.553584 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:48.553378    5258 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/67564d1b-19b9-4e46-9463-f1b4e6e99439-cacerts\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:49.110788 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:49.110751    5258 generic.go:356] "Generic (PLEG): container finished" podID="67564d1b-19b9-4e46-9463-f1b4e6e99439" containerID="6cdaa4216a7c264cdb1692caa6c488d68d6729c322e0498b17885788b78b2d8d" exitCode=0
Oct 30 22:36:49.111379 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:49.110804    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"
Oct 30 22:36:49.111379 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:49.110828    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g" event={"ID":"67564d1b-19b9-4e46-9463-f1b4e6e99439","Type":"ContainerDied","Data":"6cdaa4216a7c264cdb1692caa6c488d68d6729c322e0498b17885788b78b2d8d"}
Oct 30 22:36:49.111379 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:49.110893    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g" event={"ID":"67564d1b-19b9-4e46-9463-f1b4e6e99439","Type":"ContainerDied","Data":"ede06a734d6fb40ad4ba73a92e8a9c7bde8a5faf3994617982c886a3937c8430"}
Oct 30 22:36:49.111379 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:49.110923    5258 scope.go:122] "RemoveContainer" containerID="6cdaa4216a7c264cdb1692caa6c488d68d6729c322e0498b17885788b78b2d8d"
Oct 30 22:36:49.122432 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:49.122415    5258 scope.go:122] "RemoveContainer" containerID="6cdaa4216a7c264cdb1692caa6c488d68d6729c322e0498b17885788b78b2d8d"
Oct 30 22:36:49.122711 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:36:49.122689    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cdaa4216a7c264cdb1692caa6c488d68d6729c322e0498b17885788b78b2d8d\": container with ID starting with 6cdaa4216a7c264cdb1692caa6c488d68d6729c322e0498b17885788b78b2d8d not found: ID does not exist" containerID="6cdaa4216a7c264cdb1692caa6c488d68d6729c322e0498b17885788b78b2d8d"
Oct 30 22:36:49.122802 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:49.122723    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cdaa4216a7c264cdb1692caa6c488d68d6729c322e0498b17885788b78b2d8d"} err="failed to get container status \"6cdaa4216a7c264cdb1692caa6c488d68d6729c322e0498b17885788b78b2d8d\": rpc error: code = NotFound desc = could not find container \"6cdaa4216a7c264cdb1692caa6c488d68d6729c322e0498b17885788b78b2d8d\": container with ID starting with 6cdaa4216a7c264cdb1692caa6c488d68d6729c322e0498b17885788b78b2d8d not found: ID does not exist"
Oct 30 22:36:49.277901 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:49.277871    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"]
Oct 30 22:36:49.326988 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:49.326959    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-htl7g"]
Oct 30 22:36:49.380419 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:49.380358    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="67564d1b-19b9-4e46-9463-f1b4e6e99439" path="/var/lib/kubelet/pods/67564d1b-19b9-4e46-9463-f1b4e6e99439/volumes"
Oct 30 22:36:51.688388 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:51.688348    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:54.666661 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:54.666624    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:54.950734 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:54.950638    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:55.389291 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:55.389254    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:56.778614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:56.778553    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:58.415406 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:58.415368    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"]
Oct 30 22:36:58.415865 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:36:58.415613    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx" podUID="b7b86c2d-18a0-49bd-84cf-01bba6c4b755" containerName="istio-proxy" containerID="cri-o://bf22925509b3afe35b674fcb7f3d910b5e48cc22663bce2cfdc1e08fa0ee46cb" gracePeriod=30
Oct 30 22:37:01.911453 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:01.911412    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:02.725038 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:02.725003    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:03.678729 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.678702    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:37:03.821321 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.821292    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-data\") pod \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") "
Oct 30 22:37:03.821517 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.821327    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istiod-ca-cert\") pod \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") "
Oct 30 22:37:03.821517 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.821363    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-kube-api-access-2smjd\" (UniqueName: \"kubernetes.io/projected/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-kube-api-access-2smjd\") pod \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") "
Oct 30 22:37:03.821517 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.821422    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-credential-socket\") pod \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") "
Oct 30 22:37:03.821517 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.821504    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-envoy\") pod \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") "
Oct 30 22:37:03.821766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.821554    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-workload-certs\") pod \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") "
Oct 30 22:37:03.821766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.821671    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-token\" (UniqueName: \"kubernetes.io/projected/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-token\") pod \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") "
Oct 30 22:37:03.821766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.821721    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-workload-socket\") pod \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") "
Oct 30 22:37:03.821766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.821637    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-data" pod "b7b86c2d-18a0-49bd-84cf-01bba6c4b755" (UID: "b7b86c2d-18a0-49bd-84cf-01bba6c4b755"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:03.821978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.821773    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-podinfo\") pod \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\" (UID: \"b7b86c2d-18a0-49bd-84cf-01bba6c4b755\") "
Oct 30 22:37:03.821978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.821789    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-credential-socket" pod "b7b86c2d-18a0-49bd-84cf-01bba6c4b755" (UID: "b7b86c2d-18a0-49bd-84cf-01bba6c4b755"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:03.821978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.821806    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istiod-ca-cert" pod "b7b86c2d-18a0-49bd-84cf-01bba6c4b755" (UID: "b7b86c2d-18a0-49bd-84cf-01bba6c4b755"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:37:03.821978 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.821960    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-workload-socket" pod "b7b86c2d-18a0-49bd-84cf-01bba6c4b755" (UID: "b7b86c2d-18a0-49bd-84cf-01bba6c4b755"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:03.822220 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.821970    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-workload-certs" pod "b7b86c2d-18a0-49bd-84cf-01bba6c4b755" (UID: "b7b86c2d-18a0-49bd-84cf-01bba6c4b755"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:03.822220 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.822186    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:03.822220 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.822206    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:03.822387 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.822221    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:03.822387 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.822235    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:03.822387 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.822248    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:03.823939 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.823910    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-envoy" pod "b7b86c2d-18a0-49bd-84cf-01bba6c4b755" (UID: "b7b86c2d-18a0-49bd-84cf-01bba6c4b755"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:03.824076 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.823934    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-token" pod "b7b86c2d-18a0-49bd-84cf-01bba6c4b755" (UID: "b7b86c2d-18a0-49bd-84cf-01bba6c4b755"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:37:03.824126 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.824085    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-kube-api-access-2smjd" pod "b7b86c2d-18a0-49bd-84cf-01bba6c4b755" (UID: "b7b86c2d-18a0-49bd-84cf-01bba6c4b755"). InnerVolumeSpecName "kube-api-access-2smjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:37:03.824215 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.824196    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-podinfo" pod "b7b86c2d-18a0-49bd-84cf-01bba6c4b755" (UID: "b7b86c2d-18a0-49bd-84cf-01bba6c4b755"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:37:03.923466 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.923434    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:03.923466 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.923464    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:03.923766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.923477    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:03.923766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:03.923489    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2smjd\" (UniqueName: \"kubernetes.io/projected/b7b86c2d-18a0-49bd-84cf-01bba6c4b755-kube-api-access-2smjd\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:04.206524 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:04.206437    5258 generic.go:356] "Generic (PLEG): container finished" podID="b7b86c2d-18a0-49bd-84cf-01bba6c4b755" containerID="bf22925509b3afe35b674fcb7f3d910b5e48cc22663bce2cfdc1e08fa0ee46cb" exitCode=0
Oct 30 22:37:04.206524 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:04.206491    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"
Oct 30 22:37:04.206791 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:04.206531    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx" event={"ID":"b7b86c2d-18a0-49bd-84cf-01bba6c4b755","Type":"ContainerDied","Data":"bf22925509b3afe35b674fcb7f3d910b5e48cc22663bce2cfdc1e08fa0ee46cb"}
Oct 30 22:37:04.206791 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:04.206610    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx" event={"ID":"b7b86c2d-18a0-49bd-84cf-01bba6c4b755","Type":"ContainerDied","Data":"5f86090d04d00e506e8a11b98a1d692755cb8aa799176a1cc068b9d5cf9e647e"}
Oct 30 22:37:04.206791 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:04.206644    5258 scope.go:122] "RemoveContainer" containerID="bf22925509b3afe35b674fcb7f3d910b5e48cc22663bce2cfdc1e08fa0ee46cb"
Oct 30 22:37:04.218779 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:04.218761    5258 scope.go:122] "RemoveContainer" containerID="bf22925509b3afe35b674fcb7f3d910b5e48cc22663bce2cfdc1e08fa0ee46cb"
Oct 30 22:37:04.219049 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:37:04.219030    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf22925509b3afe35b674fcb7f3d910b5e48cc22663bce2cfdc1e08fa0ee46cb\": container with ID starting with bf22925509b3afe35b674fcb7f3d910b5e48cc22663bce2cfdc1e08fa0ee46cb not found: ID does not exist" containerID="bf22925509b3afe35b674fcb7f3d910b5e48cc22663bce2cfdc1e08fa0ee46cb"
Oct 30 22:37:04.219119 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:04.219059    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf22925509b3afe35b674fcb7f3d910b5e48cc22663bce2cfdc1e08fa0ee46cb"} err="failed to get container status \"bf22925509b3afe35b674fcb7f3d910b5e48cc22663bce2cfdc1e08fa0ee46cb\": rpc error: code = NotFound desc = could not find container \"bf22925509b3afe35b674fcb7f3d910b5e48cc22663bce2cfdc1e08fa0ee46cb\": container with ID starting with bf22925509b3afe35b674fcb7f3d910b5e48cc22663bce2cfdc1e08fa0ee46cb not found: ID does not exist"
Oct 30 22:37:04.379613 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:04.379557    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"]
Oct 30 22:37:04.384974 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:04.384949    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-c76d9e-openshift-default-5dddb76f45-hkdwx"]
Oct 30 22:37:05.380783 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:05.380753    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b7b86c2d-18a0-49bd-84cf-01bba6c4b755" path="/var/lib/kubelet/pods/b7b86c2d-18a0-49bd-84cf-01bba6c4b755/volumes"
Oct 30 22:37:06.334911 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:06.334843    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:07.907912 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:07.907872    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:08.178699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:08.178565    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:08.396366 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:08.396332    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:08.866615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:08.866546    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:12.080380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:12.080342    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:37:13.160172 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:37:13.160136    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:37:13.600825 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:13.600795    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:16.141455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:16.141412    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:16.404699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:16.404612    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:16.618839 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:16.618804    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:16.848115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:16.848077    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:18.716827 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:18.716793    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:20.066437 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:20.066398    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:20.324547 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:20.324462    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:23.095702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:23.095663    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:24.652817 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:24.652779    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:24.904060 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:24.903969    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:25.136894 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:25.136858    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:25.649553 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:25.649517    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:30.235370 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:30.235329    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:30.549724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:30.549633    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:33.209015 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:33.208980    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:37:33.211156 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:33.211122    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:33.451927 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:33.451895    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:33.501801 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:33.501728    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"]
Oct 30 22:37:33.501965 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:33.501923    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv" podUID="cc12b5a9-3464-4559-8834-01492f373f25" containerName="istio-proxy" containerID="cri-o://d5151c9a59c92c8374cfa9f8f90d7f910ae221901caa25b02a1dabc4856cea43" gracePeriod=30
Oct 30 22:37:33.758251 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:33.758157    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:35.474522 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:35.474483    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:38.763901 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.763876    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:37:38.894804 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.894771    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc12b5a9-3464-4559-8834-01492f373f25-kube-api-access-ddmc7\" (UniqueName: \"kubernetes.io/projected/cc12b5a9-3464-4559-8834-01492f373f25-kube-api-access-ddmc7\") pod \"cc12b5a9-3464-4559-8834-01492f373f25\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") "
Oct 30 22:37:38.894971 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.894829    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-workload-socket\") pod \"cc12b5a9-3464-4559-8834-01492f373f25\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") "
Oct 30 22:37:38.894971 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.894863    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cc12b5a9-3464-4559-8834-01492f373f25-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc12b5a9-3464-4559-8834-01492f373f25-istio-podinfo\") pod \"cc12b5a9-3464-4559-8834-01492f373f25\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") "
Oct 30 22:37:38.895100 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.894979    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-workload-certs\") pod \"cc12b5a9-3464-4559-8834-01492f373f25\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") "
Oct 30 22:37:38.895100 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895027    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cc12b5a9-3464-4559-8834-01492f373f25-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc12b5a9-3464-4559-8834-01492f373f25-istiod-ca-cert\") pod \"cc12b5a9-3464-4559-8834-01492f373f25\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") "
Oct 30 22:37:38.895100 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895063    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc12b5a9-3464-4559-8834-01492f373f25-istio-token\" (UniqueName: \"kubernetes.io/projected/cc12b5a9-3464-4559-8834-01492f373f25-istio-token\") pod \"cc12b5a9-3464-4559-8834-01492f373f25\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") "
Oct 30 22:37:38.895255 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895096    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-credential-socket\") pod \"cc12b5a9-3464-4559-8834-01492f373f25\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") "
Oct 30 22:37:38.895255 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895144    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-workload-socket" pod "cc12b5a9-3464-4559-8834-01492f373f25" (UID: "cc12b5a9-3464-4559-8834-01492f373f25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:38.895255 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895170    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-istio-envoy\") pod \"cc12b5a9-3464-4559-8834-01492f373f25\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") "
Oct 30 22:37:38.895255 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895248    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-istio-data\") pod \"cc12b5a9-3464-4559-8834-01492f373f25\" (UID: \"cc12b5a9-3464-4559-8834-01492f373f25\") "
Oct 30 22:37:38.895552 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895241    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-workload-certs" pod "cc12b5a9-3464-4559-8834-01492f373f25" (UID: "cc12b5a9-3464-4559-8834-01492f373f25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:38.895552 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895458    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-istio-data" pod "cc12b5a9-3464-4559-8834-01492f373f25" (UID: "cc12b5a9-3464-4559-8834-01492f373f25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:38.895552 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895489    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-credential-socket" pod "cc12b5a9-3464-4559-8834-01492f373f25" (UID: "cc12b5a9-3464-4559-8834-01492f373f25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:38.895787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895601    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc12b5a9-3464-4559-8834-01492f373f25-istiod-ca-cert" pod "cc12b5a9-3464-4559-8834-01492f373f25" (UID: "cc12b5a9-3464-4559-8834-01492f373f25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:37:38.895787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895750    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:38.895787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895773    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:38.895910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895788    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:38.895910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895802    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:38.895910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.895816    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc12b5a9-3464-4559-8834-01492f373f25-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:38.897061 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.897034    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc12b5a9-3464-4559-8834-01492f373f25-kube-api-access-ddmc7" pod "cc12b5a9-3464-4559-8834-01492f373f25" (UID: "cc12b5a9-3464-4559-8834-01492f373f25"). InnerVolumeSpecName "kube-api-access-ddmc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:37:38.897172 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.897072    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc12b5a9-3464-4559-8834-01492f373f25-istio-podinfo" pod "cc12b5a9-3464-4559-8834-01492f373f25" (UID: "cc12b5a9-3464-4559-8834-01492f373f25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:37:38.897678 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.897652    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-istio-envoy" pod "cc12b5a9-3464-4559-8834-01492f373f25" (UID: "cc12b5a9-3464-4559-8834-01492f373f25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:38.897783 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.897728    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc12b5a9-3464-4559-8834-01492f373f25-istio-token" pod "cc12b5a9-3464-4559-8834-01492f373f25" (UID: "cc12b5a9-3464-4559-8834-01492f373f25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:37:38.996609 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.996551    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc12b5a9-3464-4559-8834-01492f373f25-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:38.996768 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.996622    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc12b5a9-3464-4559-8834-01492f373f25-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:38.996768 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.996642    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddmc7\" (UniqueName: \"kubernetes.io/projected/cc12b5a9-3464-4559-8834-01492f373f25-kube-api-access-ddmc7\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:38.996768 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:38.996658    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc12b5a9-3464-4559-8834-01492f373f25-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:39.430525 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:39.430492    5258 generic.go:356] "Generic (PLEG): container finished" podID="cc12b5a9-3464-4559-8834-01492f373f25" containerID="d5151c9a59c92c8374cfa9f8f90d7f910ae221901caa25b02a1dabc4856cea43" exitCode=0
Oct 30 22:37:39.430699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:39.430538    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"
Oct 30 22:37:39.430699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:39.430581    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv" event={"ID":"cc12b5a9-3464-4559-8834-01492f373f25","Type":"ContainerDied","Data":"d5151c9a59c92c8374cfa9f8f90d7f910ae221901caa25b02a1dabc4856cea43"}
Oct 30 22:37:39.430699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:39.430647    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv" event={"ID":"cc12b5a9-3464-4559-8834-01492f373f25","Type":"ContainerDied","Data":"562228c68d3061ae1755fadb854f89c10095d4532425dc9788b8be43ff4ff700"}
Oct 30 22:37:39.430699 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:39.430669    5258 scope.go:122] "RemoveContainer" containerID="d5151c9a59c92c8374cfa9f8f90d7f910ae221901caa25b02a1dabc4856cea43"
Oct 30 22:37:39.440379 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:39.440359    5258 scope.go:122] "RemoveContainer" containerID="d5151c9a59c92c8374cfa9f8f90d7f910ae221901caa25b02a1dabc4856cea43"
Oct 30 22:37:39.440686 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:37:39.440669    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5151c9a59c92c8374cfa9f8f90d7f910ae221901caa25b02a1dabc4856cea43\": container with ID starting with d5151c9a59c92c8374cfa9f8f90d7f910ae221901caa25b02a1dabc4856cea43 not found: ID does not exist" containerID="d5151c9a59c92c8374cfa9f8f90d7f910ae221901caa25b02a1dabc4856cea43"
Oct 30 22:37:39.440737 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:39.440695    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5151c9a59c92c8374cfa9f8f90d7f910ae221901caa25b02a1dabc4856cea43"} err="failed to get container status \"d5151c9a59c92c8374cfa9f8f90d7f910ae221901caa25b02a1dabc4856cea43\": rpc error: code = NotFound desc = could not find container \"d5151c9a59c92c8374cfa9f8f90d7f910ae221901caa25b02a1dabc4856cea43\": container with ID starting with d5151c9a59c92c8374cfa9f8f90d7f910ae221901caa25b02a1dabc4856cea43 not found: ID does not exist"
Oct 30 22:37:39.597041 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:39.597007    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"]
Oct 30 22:37:39.646854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:39.646779    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-97aa64-openshift-default-569955745-qsnmv"]
Oct 30 22:37:40.601114 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:40.601079    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:41.379608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:41.379569    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc12b5a9-3464-4559-8834-01492f373f25" path="/var/lib/kubelet/pods/cc12b5a9-3464-4559-8834-01492f373f25/volumes"
Oct 30 22:37:43.160483 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:37:43.160447    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:37:45.680730 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:45.680693    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:50.706043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:50.706000    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:53.922171 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:53.922127    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:37:55.856438 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:37:55.856404    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:00.987392 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:00.987350    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:06.116166 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:06.116130    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:11.178691 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:11.178651    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:13.160295 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:38:13.160262    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:38:16.197123 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:16.197076    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:21.288094 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:21.288053    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:26.526159 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:26.526069    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:30.578917 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:30.578879    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:31.599295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:31.599255    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:33.692852 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:33.692812    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:36.591020 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:36.590982    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:40.559638 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:40.559580    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:38:41.820266 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:41.820224    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:43.160710 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:38:43.160669    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:38:46.923547 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:46.923512    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:51.363539 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:51.363505    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:51.633787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:51.633710    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:51.889036 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:51.888943    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:53.067072 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:53.067023    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:56.999287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:56.999256    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:38:57.190168 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:38:57.190118    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:02.426019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:02.425983    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:05.478167 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:05.478126    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:05.698084 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:05.698052    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:07.396109 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:07.396066    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:12.381349 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:12.381311    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:13.160747 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:39:13.160713    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:39:13.639254 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:13.639215    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:13.855155 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:13.855109    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:17.394264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:17.394231    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:21.602427 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:21.602390    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"]
Oct 30 22:39:21.602857 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:21.602600    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6" podUID="0c4c17af-3fd3-41e0-a5d3-92cad35330a0" containerName="maas-api" containerID="cri-o://b2077de83a5ad2924837eeb92cd56fb0babec7de1326240cbd3d0a2348e99873" gracePeriod=30
Oct 30 22:39:21.770063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:21.770013    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:21.870784 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:21.870760    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:39:22.033403 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.033368    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-openshift-service-ca\") pod \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") "
Oct 30 22:39:22.033627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.033445    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-kube-api-access-2r6fl\" (UniqueName: \"kubernetes.io/projected/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-kube-api-access-2r6fl\") pod \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") "
Oct 30 22:39:22.033627 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.033513    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-metrics-certs\") pod \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") "
Oct 30 22:39:22.033781 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.033646    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-maas-api-tls\") pod \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\" (UID: \"0c4c17af-3fd3-41e0-a5d3-92cad35330a0\") "
Oct 30 22:39:22.033855 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.033808    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-openshift-service-ca" pod "0c4c17af-3fd3-41e0-a5d3-92cad35330a0" (UID: "0c4c17af-3fd3-41e0-a5d3-92cad35330a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:39:22.034113 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.034090    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:39:22.036170 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.036130    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-metrics-certs" pod "0c4c17af-3fd3-41e0-a5d3-92cad35330a0" (UID: "0c4c17af-3fd3-41e0-a5d3-92cad35330a0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:39:22.036316 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.036286    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-kube-api-access-2r6fl" pod "0c4c17af-3fd3-41e0-a5d3-92cad35330a0" (UID: "0c4c17af-3fd3-41e0-a5d3-92cad35330a0"). InnerVolumeSpecName "kube-api-access-2r6fl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:39:22.037160 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.037130    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-maas-api-tls" pod "0c4c17af-3fd3-41e0-a5d3-92cad35330a0" (UID: "0c4c17af-3fd3-41e0-a5d3-92cad35330a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:39:22.040574 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.040546    5258 generic.go:356] "Generic (PLEG): container finished" podID="0c4c17af-3fd3-41e0-a5d3-92cad35330a0" containerID="b2077de83a5ad2924837eeb92cd56fb0babec7de1326240cbd3d0a2348e99873" exitCode=0
Oct 30 22:39:22.040683 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.040608    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"
Oct 30 22:39:22.040683 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.040636    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6" event={"ID":"0c4c17af-3fd3-41e0-a5d3-92cad35330a0","Type":"ContainerDied","Data":"b2077de83a5ad2924837eeb92cd56fb0babec7de1326240cbd3d0a2348e99873"}
Oct 30 22:39:22.040761 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.040721    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6" event={"ID":"0c4c17af-3fd3-41e0-a5d3-92cad35330a0","Type":"ContainerDied","Data":"dff5dc625fcbeeb3902771f5b0bde7afbb519467f516c94e60207a6a4134fea9"}
Oct 30 22:39:22.040761 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.040751    5258 scope.go:122] "RemoveContainer" containerID="b2077de83a5ad2924837eeb92cd56fb0babec7de1326240cbd3d0a2348e99873"
Oct 30 22:39:22.058415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.058398    5258 scope.go:122] "RemoveContainer" containerID="b2077de83a5ad2924837eeb92cd56fb0babec7de1326240cbd3d0a2348e99873"
Oct 30 22:39:22.058675 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:39:22.058655    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2077de83a5ad2924837eeb92cd56fb0babec7de1326240cbd3d0a2348e99873\": container with ID starting with b2077de83a5ad2924837eeb92cd56fb0babec7de1326240cbd3d0a2348e99873 not found: ID does not exist" containerID="b2077de83a5ad2924837eeb92cd56fb0babec7de1326240cbd3d0a2348e99873"
Oct 30 22:39:22.058744 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.058687    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2077de83a5ad2924837eeb92cd56fb0babec7de1326240cbd3d0a2348e99873"} err="failed to get container status \"b2077de83a5ad2924837eeb92cd56fb0babec7de1326240cbd3d0a2348e99873\": rpc error: code = NotFound desc = could not find container \"b2077de83a5ad2924837eeb92cd56fb0babec7de1326240cbd3d0a2348e99873\": container with ID starting with b2077de83a5ad2924837eeb92cd56fb0babec7de1326240cbd3d0a2348e99873 not found: ID does not exist"
Oct 30 22:39:22.134869 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.134791    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r6fl\" (UniqueName: \"kubernetes.io/projected/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-kube-api-access-2r6fl\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:39:22.134869 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.134820    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:39:22.134869 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.134829    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c4c17af-3fd3-41e0-a5d3-92cad35330a0-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:39:22.210902 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.210870    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"]
Oct 30 22:39:22.213325 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:22.213302    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cd5407-79d9bdf44c-pbrs6"]
Oct 30 22:39:23.376395 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:23.376364    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:23.380994 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:23.380970    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0c4c17af-3fd3-41e0-a5d3-92cad35330a0" path="/var/lib/kubelet/pods/0c4c17af-3fd3-41e0-a5d3-92cad35330a0/volumes"
Oct 30 22:39:23.610582 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:23.610543    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:23.841124 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:23.841088    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:24.413930 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:24.413885    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:27.767034 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:27.766997    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:39:29.026958 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:29.026923    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:30.943739 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:30.943708    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:32.015258 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:32.015229    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:34.123008 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:34.122966    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:34.523143 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:34.523045    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:39.584349 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:39.584306    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:43.160785 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:39:43.160743    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:39:44.585192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:44.585154    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:45.145323 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:45.145282    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:45.363009 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:45.362972    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:45.815305 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:45.815276    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:39:45.818787 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:45.818755    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:39:49.716424 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:49.716384    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:54.021760 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.021727    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"]
Oct 30 22:39:54.022229 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.021922    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd" podUID="2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a" containerName="maas-api" containerID="cri-o://3c92fdf9444a60d68804beffedd9a93e5bfe3f28da98de4398f2e1f6e5290b42" gracePeriod=30
Oct 30 22:39:54.190485 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.190455    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:54.244835 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.244794    5258 generic.go:356] "Generic (PLEG): container finished" podID="2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a" containerID="3c92fdf9444a60d68804beffedd9a93e5bfe3f28da98de4398f2e1f6e5290b42" exitCode=0
Oct 30 22:39:54.245039 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.244875    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd" event={"ID":"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a","Type":"ContainerDied","Data":"3c92fdf9444a60d68804beffedd9a93e5bfe3f28da98de4398f2e1f6e5290b42"}
Oct 30 22:39:54.279572 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.279509    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:39:54.466098 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.466063    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-openshift-service-ca\") pod \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") "
Oct 30 22:39:54.466292 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.466183    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-maas-api-tls\") pod \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") "
Oct 30 22:39:54.466292 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.466279    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-metrics-certs\") pod \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") "
Oct 30 22:39:54.466424 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.466327    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-kube-api-access-h6wfl\" (UniqueName: \"kubernetes.io/projected/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-kube-api-access-h6wfl\") pod \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\" (UID: \"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a\") "
Oct 30 22:39:54.466510 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.466481    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-openshift-service-ca" pod "2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a" (UID: "2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:39:54.466831 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.466808    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:39:54.468296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.468270    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-maas-api-tls" pod "2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a" (UID: "2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:39:54.468473 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.468454    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-kube-api-access-h6wfl" pod "2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a" (UID: "2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a"). InnerVolumeSpecName "kube-api-access-h6wfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:39:54.468539 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.468492    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-metrics-certs" pod "2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a" (UID: "2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:39:54.567697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.567667    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:39:54.567697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.567695    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6wfl\" (UniqueName: \"kubernetes.io/projected/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-kube-api-access-h6wfl\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:39:54.567884 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:54.567705    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:39:55.251670 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:55.251643    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"
Oct 30 22:39:55.252108 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:55.251639    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd" event={"ID":"2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a","Type":"ContainerDied","Data":"cbd5e38e90017c265604a078b52bd05e7aaa6fa051632673a06dda2339aaa927"}
Oct 30 22:39:55.252108 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:55.251794    5258 scope.go:122] "RemoveContainer" containerID="3c92fdf9444a60d68804beffedd9a93e5bfe3f28da98de4398f2e1f6e5290b42"
Oct 30 22:39:55.420408 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:55.420375    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"]
Oct 30 22:39:55.468130 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:55.468102    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e54161-74d94d548c-qckbd"]
Oct 30 22:39:55.790767 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:55.790681    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:56.074931 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:56.074894    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:56.311353 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:56.311308    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:56.783653 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:56.783620    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:57.380862 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:39:57.380827    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a" path="/var/lib/kubelet/pods/2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a/volumes"
Oct 30 22:40:00.165346 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:00.165306    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:40:01.431744 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:01.431694    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:04.535890 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:04.535846    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:04.752064 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:04.752023    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:04.824242 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:04.824209    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"]
Oct 30 22:40:04.824494 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:04.824470    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t" podUID="c3982e61-9743-45e3-936e-826d18355971" containerName="istio-proxy" containerID="cri-o://fce4907d2b21686c3db6fbc699264dd0848a1c12349337ac0381fcdab5aedfef" gracePeriod=30
Oct 30 22:40:04.977565 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:04.977525    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:06.816207 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:06.816172    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:08.024951 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:08.024912    5258 patch_prober.go:29] interesting pod/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:40:08.025358 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:08.024969    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t" podUID="c3982e61-9743-45e3-936e-826d18355971" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:40:10.073118 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.073090    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:40:10.124128 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124063    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-workload-socket\") pod \"c3982e61-9743-45e3-936e-826d18355971\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") "
Oct 30 22:40:10.124128 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124107    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3982e61-9743-45e3-936e-826d18355971-kube-api-access-m8wh2\" (UniqueName: \"kubernetes.io/projected/c3982e61-9743-45e3-936e-826d18355971-kube-api-access-m8wh2\") pod \"c3982e61-9743-45e3-936e-826d18355971\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") "
Oct 30 22:40:10.124331 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124130    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c3982e61-9743-45e3-936e-826d18355971-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3982e61-9743-45e3-936e-826d18355971-istiod-ca-cert\") pod \"c3982e61-9743-45e3-936e-826d18355971\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") "
Oct 30 22:40:10.124331 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124171    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3982e61-9743-45e3-936e-826d18355971-istio-token\" (UniqueName: \"kubernetes.io/projected/c3982e61-9743-45e3-936e-826d18355971-istio-token\") pod \"c3982e61-9743-45e3-936e-826d18355971\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") "
Oct 30 22:40:10.124331 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124211    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-istio-envoy\") pod \"c3982e61-9743-45e3-936e-826d18355971\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") "
Oct 30 22:40:10.124331 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124250    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-istio-data\") pod \"c3982e61-9743-45e3-936e-826d18355971\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") "
Oct 30 22:40:10.124331 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124293    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c3982e61-9743-45e3-936e-826d18355971-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3982e61-9743-45e3-936e-826d18355971-istio-podinfo\") pod \"c3982e61-9743-45e3-936e-826d18355971\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") "
Oct 30 22:40:10.124331 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124326    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-credential-socket\") pod \"c3982e61-9743-45e3-936e-826d18355971\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") "
Oct 30 22:40:10.124725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124347    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-workload-socket" pod "c3982e61-9743-45e3-936e-826d18355971" (UID: "c3982e61-9743-45e3-936e-826d18355971"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:40:10.124725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124398    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-workload-certs\") pod \"c3982e61-9743-45e3-936e-826d18355971\" (UID: \"c3982e61-9743-45e3-936e-826d18355971\") "
Oct 30 22:40:10.124725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124539    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-istio-data" pod "c3982e61-9743-45e3-936e-826d18355971" (UID: "c3982e61-9743-45e3-936e-826d18355971"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:40:10.124725 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124621    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3982e61-9743-45e3-936e-826d18355971-istiod-ca-cert" pod "c3982e61-9743-45e3-936e-826d18355971" (UID: "c3982e61-9743-45e3-936e-826d18355971"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:40:10.124930 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124729    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-credential-socket" pod "c3982e61-9743-45e3-936e-826d18355971" (UID: "c3982e61-9743-45e3-936e-826d18355971"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:40:10.124930 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124846    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-workload-certs" pod "c3982e61-9743-45e3-936e-826d18355971" (UID: "c3982e61-9743-45e3-936e-826d18355971"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:40:10.124930 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124910    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:40:10.125069 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124933    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3982e61-9743-45e3-936e-826d18355971-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:40:10.125069 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124948    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:40:10.125069 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.124961    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:40:10.126814 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.126781    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-istio-envoy" pod "c3982e61-9743-45e3-936e-826d18355971" (UID: "c3982e61-9743-45e3-936e-826d18355971"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:40:10.126814 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.126801    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3982e61-9743-45e3-936e-826d18355971-kube-api-access-m8wh2" pod "c3982e61-9743-45e3-936e-826d18355971" (UID: "c3982e61-9743-45e3-936e-826d18355971"). InnerVolumeSpecName "kube-api-access-m8wh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:40:10.126957 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.126890    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3982e61-9743-45e3-936e-826d18355971-istio-podinfo" pod "c3982e61-9743-45e3-936e-826d18355971" (UID: "c3982e61-9743-45e3-936e-826d18355971"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:40:10.126998 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.126954    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3982e61-9743-45e3-936e-826d18355971-istio-token" pod "c3982e61-9743-45e3-936e-826d18355971" (UID: "c3982e61-9743-45e3-936e-826d18355971"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:40:10.225772 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.225740    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3982e61-9743-45e3-936e-826d18355971-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:40:10.225772 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.225770    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:40:10.226019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.225781    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8wh2\" (UniqueName: \"kubernetes.io/projected/c3982e61-9743-45e3-936e-826d18355971-kube-api-access-m8wh2\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:40:10.226019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.225791    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3982e61-9743-45e3-936e-826d18355971-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:40:10.226019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.225800    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3982e61-9743-45e3-936e-826d18355971-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:40:10.352059 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.352026    5258 generic.go:356] "Generic (PLEG): container finished" podID="c3982e61-9743-45e3-936e-826d18355971" containerID="fce4907d2b21686c3db6fbc699264dd0848a1c12349337ac0381fcdab5aedfef" exitCode=0
Oct 30 22:40:10.352268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.352082    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"
Oct 30 22:40:10.352268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.352106    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t" event={"ID":"c3982e61-9743-45e3-936e-826d18355971","Type":"ContainerDied","Data":"fce4907d2b21686c3db6fbc699264dd0848a1c12349337ac0381fcdab5aedfef"}
Oct 30 22:40:10.352268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.352169    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t" event={"ID":"c3982e61-9743-45e3-936e-826d18355971","Type":"ContainerDied","Data":"402025ec8088ce475a1552676a0bcef6b7c8bb92e6ad166d067a27d027c97d24"}
Oct 30 22:40:10.352268 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.352201    5258 scope.go:122] "RemoveContainer" containerID="fce4907d2b21686c3db6fbc699264dd0848a1c12349337ac0381fcdab5aedfef"
Oct 30 22:40:10.363975 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.363954    5258 scope.go:122] "RemoveContainer" containerID="8faeb63196ef9e327826f685e5dc9cee7f462948e03dbcd2d18c74e8d385a622"
Oct 30 22:40:10.372814 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.372785    5258 scope.go:122] "RemoveContainer" containerID="fce4907d2b21686c3db6fbc699264dd0848a1c12349337ac0381fcdab5aedfef"
Oct 30 22:40:10.373104 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:40:10.373079    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fce4907d2b21686c3db6fbc699264dd0848a1c12349337ac0381fcdab5aedfef\": container with ID starting with fce4907d2b21686c3db6fbc699264dd0848a1c12349337ac0381fcdab5aedfef not found: ID does not exist" containerID="fce4907d2b21686c3db6fbc699264dd0848a1c12349337ac0381fcdab5aedfef"
Oct 30 22:40:10.373171 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.373118    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fce4907d2b21686c3db6fbc699264dd0848a1c12349337ac0381fcdab5aedfef"} err="failed to get container status \"fce4907d2b21686c3db6fbc699264dd0848a1c12349337ac0381fcdab5aedfef\": rpc error: code = NotFound desc = could not find container \"fce4907d2b21686c3db6fbc699264dd0848a1c12349337ac0381fcdab5aedfef\": container with ID starting with fce4907d2b21686c3db6fbc699264dd0848a1c12349337ac0381fcdab5aedfef not found: ID does not exist"
Oct 30 22:40:10.373171 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.373144    5258 scope.go:122] "RemoveContainer" containerID="8faeb63196ef9e327826f685e5dc9cee7f462948e03dbcd2d18c74e8d385a622"
Oct 30 22:40:10.373403 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:40:10.373385    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8faeb63196ef9e327826f685e5dc9cee7f462948e03dbcd2d18c74e8d385a622\": container with ID starting with 8faeb63196ef9e327826f685e5dc9cee7f462948e03dbcd2d18c74e8d385a622 not found: ID does not exist" containerID="8faeb63196ef9e327826f685e5dc9cee7f462948e03dbcd2d18c74e8d385a622"
Oct 30 22:40:10.373459 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.373409    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8faeb63196ef9e327826f685e5dc9cee7f462948e03dbcd2d18c74e8d385a622"} err="failed to get container status \"8faeb63196ef9e327826f685e5dc9cee7f462948e03dbcd2d18c74e8d385a622\": rpc error: code = NotFound desc = could not find container \"8faeb63196ef9e327826f685e5dc9cee7f462948e03dbcd2d18c74e8d385a622\": container with ID starting with 8faeb63196ef9e327826f685e5dc9cee7f462948e03dbcd2d18c74e8d385a622 not found: ID does not exist"
Oct 30 22:40:10.521063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.520990    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"]
Oct 30 22:40:10.527336 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:10.527313    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e54161-openshift-default-7899496757-cmj5t"]
Oct 30 22:40:11.379489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:11.379450    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c3982e61-9743-45e3-936e-826d18355971" path="/var/lib/kubelet/pods/c3982e61-9743-45e3-936e-826d18355971/volumes"
Oct 30 22:40:12.237427 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:12.237391    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:13.163529 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:40:13.163492    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:40:16.638472 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:16.638434    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:17.179823 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:17.179785    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:17.489782 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:17.489571    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:18.581258 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:18.581226    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:21.425308 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:21.425268    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:21.731910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:21.731814    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:22.255814 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:22.255784    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:22.511295 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:22.511198    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:22.609256 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:22.609222    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:40:23.872911 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:23.872869    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:29.099858 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:29.099818    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:29.872369 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:29.872329    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:30.110909 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:30.110870    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:30.332712 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:30.332677    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:31.289906 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:31.289870    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:31.537692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:31.537655    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:34.571409 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:34.571365    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:39.690045 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:39.690003    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:43.030799 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:43.030755    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:43.166482 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:40:43.166437    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:40:43.257246 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:43.257212    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:44.805220 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:44.805182    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:49.979003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:49.978967    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:54.276022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.275979    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"]
Oct 30 22:40:54.276566 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.276195    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh" podUID="a64e5054-857f-4eb2-9180-a547caf0ad09" containerName="maas-api" containerID="cri-o://a94d0a72dd2017e2b6cbeae4d163696bd02ba3092d916d0c384446dc1f2a08d7" gracePeriod=30
Oct 30 22:40:54.441604 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.441564    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:54.540563 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.540509    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:40:54.602291 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.602257    5258 generic.go:356] "Generic (PLEG): container finished" podID="a64e5054-857f-4eb2-9180-a547caf0ad09" containerID="a94d0a72dd2017e2b6cbeae4d163696bd02ba3092d916d0c384446dc1f2a08d7" exitCode=0
Oct 30 22:40:54.602432 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.602299    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"
Oct 30 22:40:54.602432 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.602307    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh" event={"ID":"a64e5054-857f-4eb2-9180-a547caf0ad09","Type":"ContainerDied","Data":"a94d0a72dd2017e2b6cbeae4d163696bd02ba3092d916d0c384446dc1f2a08d7"}
Oct 30 22:40:54.602432 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.602355    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh" event={"ID":"a64e5054-857f-4eb2-9180-a547caf0ad09","Type":"ContainerDied","Data":"61d4f662c138f7a710f4e01fb3ed02c27f773d1656fc57fefe6c38bf6ae2a99c"}
Oct 30 22:40:54.602432 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.602377    5258 scope.go:122] "RemoveContainer" containerID="a94d0a72dd2017e2b6cbeae4d163696bd02ba3092d916d0c384446dc1f2a08d7"
Oct 30 22:40:54.611803 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.611781    5258 scope.go:122] "RemoveContainer" containerID="a94d0a72dd2017e2b6cbeae4d163696bd02ba3092d916d0c384446dc1f2a08d7"
Oct 30 22:40:54.612066 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:40:54.612048    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a94d0a72dd2017e2b6cbeae4d163696bd02ba3092d916d0c384446dc1f2a08d7\": container with ID starting with a94d0a72dd2017e2b6cbeae4d163696bd02ba3092d916d0c384446dc1f2a08d7 not found: ID does not exist" containerID="a94d0a72dd2017e2b6cbeae4d163696bd02ba3092d916d0c384446dc1f2a08d7"
Oct 30 22:40:54.612116 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.612076    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a94d0a72dd2017e2b6cbeae4d163696bd02ba3092d916d0c384446dc1f2a08d7"} err="failed to get container status \"a94d0a72dd2017e2b6cbeae4d163696bd02ba3092d916d0c384446dc1f2a08d7\": rpc error: code = NotFound desc = could not find container \"a94d0a72dd2017e2b6cbeae4d163696bd02ba3092d916d0c384446dc1f2a08d7\": container with ID starting with a94d0a72dd2017e2b6cbeae4d163696bd02ba3092d916d0c384446dc1f2a08d7 not found: ID does not exist"
Oct 30 22:40:54.675773 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.675727    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a64e5054-857f-4eb2-9180-a547caf0ad09-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a64e5054-857f-4eb2-9180-a547caf0ad09-openshift-service-ca\") pod \"a64e5054-857f-4eb2-9180-a547caf0ad09\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") "
Oct 30 22:40:54.676183 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.676162    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a64e5054-857f-4eb2-9180-a547caf0ad09-kube-api-access-v2j4m\" (UniqueName: \"kubernetes.io/projected/a64e5054-857f-4eb2-9180-a547caf0ad09-kube-api-access-v2j4m\") pod \"a64e5054-857f-4eb2-9180-a547caf0ad09\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") "
Oct 30 22:40:54.676415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.676397    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-maas-api-tls\") pod \"a64e5054-857f-4eb2-9180-a547caf0ad09\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") "
Oct 30 22:40:54.677706 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.677684    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-metrics-certs\") pod \"a64e5054-857f-4eb2-9180-a547caf0ad09\" (UID: \"a64e5054-857f-4eb2-9180-a547caf0ad09\") "
Oct 30 22:40:54.680783 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.676981    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a64e5054-857f-4eb2-9180-a547caf0ad09-openshift-service-ca" pod "a64e5054-857f-4eb2-9180-a547caf0ad09" (UID: "a64e5054-857f-4eb2-9180-a547caf0ad09"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:40:54.684982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.682117    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-maas-api-tls" pod "a64e5054-857f-4eb2-9180-a547caf0ad09" (UID: "a64e5054-857f-4eb2-9180-a547caf0ad09"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:40:54.684982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.684035    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a64e5054-857f-4eb2-9180-a547caf0ad09-kube-api-access-v2j4m" pod "a64e5054-857f-4eb2-9180-a547caf0ad09" (UID: "a64e5054-857f-4eb2-9180-a547caf0ad09"). InnerVolumeSpecName "kube-api-access-v2j4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:40:54.685296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.685272    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-metrics-certs" pod "a64e5054-857f-4eb2-9180-a547caf0ad09" (UID: "a64e5054-857f-4eb2-9180-a547caf0ad09"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:40:54.779205 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.779168    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2j4m\" (UniqueName: \"kubernetes.io/projected/a64e5054-857f-4eb2-9180-a547caf0ad09-kube-api-access-v2j4m\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:40:54.779205 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.779203    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:40:54.779426 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.779214    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a64e5054-857f-4eb2-9180-a547caf0ad09-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:40:54.779426 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:54.779224    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a64e5054-857f-4eb2-9180-a547caf0ad09-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:40:55.025484 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:55.025446    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"]
Oct 30 22:40:55.033000 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:55.032970    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-6c7d3f-5486788ffd-wm6fh"]
Oct 30 22:40:55.379692 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:55.379660    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a64e5054-857f-4eb2-9180-a547caf0ad09" path="/var/lib/kubelet/pods/a64e5054-857f-4eb2-9180-a547caf0ad09/volumes"
Oct 30 22:40:56.086583 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:56.086538    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:56.306621 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:56.306578    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:56.531438 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:56.531348    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:57.011429 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:57.011396    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:59.981023 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:40:59.980989    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:41:01.900535 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:01.900495    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:05.036463 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:05.036422    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:05.323438 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:05.323400    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:05.605889 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:05.605778    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:05.895805 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:05.895715    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:06.386226 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.386173    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:06.422529 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.422487    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"]
Oct 30 22:41:06.423018 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.422999    5258 cpu_manager.go:414] "containerMap: removing container" podUID="b7b86c2d-18a0-49bd-84cf-01bba6c4b755" containerName="istio-proxy"
Oct 30 22:41:06.423121 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423019    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7b86c2d-18a0-49bd-84cf-01bba6c4b755" containerName="istio-proxy"
Oct 30 22:41:06.423121 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423038    5258 cpu_manager.go:414] "containerMap: removing container" podUID="2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a" containerName="maas-api"
Oct 30 22:41:06.423121 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423046    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a" containerName="maas-api"
Oct 30 22:41:06.423121 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423062    5258 cpu_manager.go:414] "containerMap: removing container" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main"
Oct 30 22:41:06.423121 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423070    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main"
Oct 30 22:41:06.423121 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423087    5258 cpu_manager.go:414] "containerMap: removing container" podUID="0c4c17af-3fd3-41e0-a5d3-92cad35330a0" containerName="maas-api"
Oct 30 22:41:06.423121 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423094    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c4c17af-3fd3-41e0-a5d3-92cad35330a0" containerName="maas-api"
Oct 30 22:41:06.423121 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423111    5258 cpu_manager.go:414] "containerMap: removing container" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main"
Oct 30 22:41:06.423121 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423118    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423132    5258 cpu_manager.go:414] "containerMap: removing container" podUID="8891fbb0-53aa-451f-8971-e20fb5db3ddd" containerName="payload-pre-processing"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423140    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8891fbb0-53aa-451f-8971-e20fb5db3ddd" containerName="payload-pre-processing"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423156    5258 cpu_manager.go:414] "containerMap: removing container" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423164    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423175    5258 cpu_manager.go:414] "containerMap: removing container" podUID="2ddb2f4d-1a6e-4b97-bada-6997a01536d1" containerName="payload-processing"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423181    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ddb2f4d-1a6e-4b97-bada-6997a01536d1" containerName="payload-processing"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423191    5258 cpu_manager.go:414] "containerMap: removing container" podUID="cc12b5a9-3464-4559-8834-01492f373f25" containerName="istio-proxy"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423201    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc12b5a9-3464-4559-8834-01492f373f25" containerName="istio-proxy"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423213    5258 cpu_manager.go:414] "containerMap: removing container" podUID="a64e5054-857f-4eb2-9180-a547caf0ad09" containerName="maas-api"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423220    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a64e5054-857f-4eb2-9180-a547caf0ad09" containerName="maas-api"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423231    5258 cpu_manager.go:414] "containerMap: removing container" podUID="b7de5d2b-2183-4fce-bff9-3e18fce386e2" containerName="payload-processing"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423239    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7de5d2b-2183-4fce-bff9-3e18fce386e2" containerName="payload-processing"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423258    5258 cpu_manager.go:414] "containerMap: removing container" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423265    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423279    5258 cpu_manager.go:414] "containerMap: removing container" podUID="c3982e61-9743-45e3-936e-826d18355971" containerName="istio-proxy"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423286    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c3982e61-9743-45e3-936e-826d18355971" containerName="istio-proxy"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423296    5258 cpu_manager.go:414] "containerMap: removing container" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423303    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423314    5258 cpu_manager.go:414] "containerMap: removing container" podUID="67564d1b-19b9-4e46-9463-f1b4e6e99439" containerName="discovery"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423321    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="67564d1b-19b9-4e46-9463-f1b4e6e99439" containerName="discovery"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423335    5258 cpu_manager.go:414] "containerMap: removing container" podUID="c3982e61-9743-45e3-936e-826d18355971" containerName="istio-proxy"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423343    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c3982e61-9743-45e3-936e-826d18355971" containerName="istio-proxy"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423356    5258 cpu_manager.go:414] "containerMap: removing container" podUID="f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" containerName="istio-proxy"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423363    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" containerName="istio-proxy"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423481    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="691a53b3-2708-4de9-b5c5-e0a7b322e899" containerName="main"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423497    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="8891fbb0-53aa-451f-8971-e20fb5db3ddd" containerName="payload-pre-processing"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423509    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="39c00f4f-9fae-4aac-acf3-335d0055b534" containerName="main"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423518    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ddb2f4d-1a6e-4b97-bada-6997a01536d1" containerName="payload-processing"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423528    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc12b5a9-3464-4559-8834-01492f373f25" containerName="istio-proxy"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423537    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="a64e5054-857f-4eb2-9180-a547caf0ad09" containerName="maas-api"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423547    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="b7de5d2b-2183-4fce-bff9-3e18fce386e2" containerName="payload-processing"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423558    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1ab3125-0789-4c58-9b92-fd7f46ed3b0c" containerName="main"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423568    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="c3982e61-9743-45e3-936e-826d18355971" containerName="istio-proxy"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423578    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="8b2b24d4-20da-4f1d-b968-c11031f364c4" containerName="main"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423601    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="67564d1b-19b9-4e46-9463-f1b4e6e99439" containerName="discovery"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423611    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="c3982e61-9743-45e3-936e-826d18355971" containerName="istio-proxy"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423621    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="f2fc3f93-a312-47c1-9cfb-2cf4b4ca423c" containerName="istio-proxy"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423632    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="b7b86c2d-18a0-49bd-84cf-01bba6c4b755" containerName="istio-proxy"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423643    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="2148eb8f-5b97-4c9d-b8f3-b04dfe049e0a" containerName="maas-api"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423652    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa100c4d-158f-4995-b648-b5524aa575b5" containerName="main"
Oct 30 22:41:06.423702 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.423662    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="0c4c17af-3fd3-41e0-a5d3-92cad35330a0" containerName="maas-api"
Oct 30 22:41:06.428614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.428571    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"
Oct 30 22:41:06.491287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.491251    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"]
Oct 30 22:41:06.499584 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.499548    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd\" (UID: \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"
Oct 30 22:41:06.499831 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.499651    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7wdk\" (UniqueName: \"kubernetes.io/projected/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-kube-api-access-g7wdk\") pod \"maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd\" (UID: \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"
Oct 30 22:41:06.499831 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.499728    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd\" (UID: \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"
Oct 30 22:41:06.531874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.531842    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:41:06.531874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.531868    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:41:06.532095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.531922    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:41:06.532095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.531999    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l4mjj\""
Oct 30 22:41:06.600819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.600778    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd\" (UID: \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"
Oct 30 22:41:06.600819 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.600818    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7wdk\" (UniqueName: \"kubernetes.io/projected/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-kube-api-access-g7wdk\") pod \"maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd\" (UID: \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"
Oct 30 22:41:06.601119 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.600840    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd\" (UID: \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"
Oct 30 22:41:06.601772 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.601738    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd\" (UID: \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"
Oct 30 22:41:06.603348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.603321    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd\" (UID: \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"
Oct 30 22:41:06.664019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.663940    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7wdk\" (UniqueName: \"kubernetes.io/projected/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-kube-api-access-g7wdk\") pod \"maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd\" (UID: \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"
Oct 30 22:41:06.741767 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:06.741727    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"
Oct 30 22:41:07.024217 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:07.024125    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:07.122081 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:07.122052    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"]
Oct 30 22:41:07.124467 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:41:07.124438    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd80e7d11_8916_41ea_b11c_b69b5e40a4fc.slice/crio-2cf17f62950883f1c8a107833dad70863a8e0d43f43b11aa0014f5f3affae8cf WatchSource:0}: Error finding container 2cf17f62950883f1c8a107833dad70863a8e0d43f43b11aa0014f5f3affae8cf: Status 404 returned error can't find the container with id 2cf17f62950883f1c8a107833dad70863a8e0d43f43b11aa0014f5f3affae8cf
Oct 30 22:41:07.681566 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:07.681468    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd" event={"ID":"d80e7d11-8916-41ea-b11c-b69b5e40a4fc","Type":"ContainerStarted","Data":"d56c1512b629df0f6b89aa2d95cc4c119b99e6995922137c49fda3fb1b528ecd"}
Oct 30 22:41:07.681566 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:07.681533    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd" event={"ID":"d80e7d11-8916-41ea-b11c-b69b5e40a4fc","Type":"ContainerStarted","Data":"2cf17f62950883f1c8a107833dad70863a8e0d43f43b11aa0014f5f3affae8cf"}
Oct 30 22:41:07.801794 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:07.801729    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd" podStartSLOduration=1.801710269 podStartE2EDuration="1.801710269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:41:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:41:07.799664791 +0000 UTC m=+2782.530521936" watchObservedRunningTime="2026-10-30 22:41:07.801710269 +0000 UTC m=+2782.532567413"
Oct 30 22:41:08.689967 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:08.689930    5258 generic.go:356] "Generic (PLEG): container finished" podID="d80e7d11-8916-41ea-b11c-b69b5e40a4fc" containerID="d56c1512b629df0f6b89aa2d95cc4c119b99e6995922137c49fda3fb1b528ecd" exitCode=0
Oct 30 22:41:08.690391 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:08.690010    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd" event={"ID":"d80e7d11-8916-41ea-b11c-b69b5e40a4fc","Type":"ContainerDied","Data":"d56c1512b629df0f6b89aa2d95cc4c119b99e6995922137c49fda3fb1b528ecd"}
Oct 30 22:41:09.845051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:09.845026    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"
Oct 30 22:41:09.928394 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:09.928367    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-kube-api-access-g7wdk\" (UniqueName: \"kubernetes.io/projected/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-kube-api-access-g7wdk\") pod \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\" (UID: \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\") "
Oct 30 22:41:09.928562 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:09.928415    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-maas-api-openshift-ca\") pod \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\" (UID: \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\") "
Oct 30 22:41:09.928562 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:09.928487    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-maas-api-xks-ca\") pod \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\" (UID: \"d80e7d11-8916-41ea-b11c-b69b5e40a4fc\") "
Oct 30 22:41:09.928806 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:09.928784    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-maas-api-openshift-ca" pod "d80e7d11-8916-41ea-b11c-b69b5e40a4fc" (UID: "d80e7d11-8916-41ea-b11c-b69b5e40a4fc"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:41:09.930499 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:09.930468    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-kube-api-access-g7wdk" pod "d80e7d11-8916-41ea-b11c-b69b5e40a4fc" (UID: "d80e7d11-8916-41ea-b11c-b69b5e40a4fc"). InnerVolumeSpecName "kube-api-access-g7wdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:41:09.930639 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:09.930504    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-maas-api-xks-ca" pod "d80e7d11-8916-41ea-b11c-b69b5e40a4fc" (UID: "d80e7d11-8916-41ea-b11c-b69b5e40a4fc"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:41:10.030247 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:10.030151    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7wdk\" (UniqueName: \"kubernetes.io/projected/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-kube-api-access-g7wdk\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:10.030247 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:10.030205    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-maas-api-openshift-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:10.030481 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:10.030250    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d80e7d11-8916-41ea-b11c-b69b5e40a4fc-maas-api-xks-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:10.704676 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:10.704644    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"
Oct 30 22:41:10.704676 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:10.704661    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd" event={"ID":"d80e7d11-8916-41ea-b11c-b69b5e40a4fc","Type":"ContainerDied","Data":"2cf17f62950883f1c8a107833dad70863a8e0d43f43b11aa0014f5f3affae8cf"}
Oct 30 22:41:10.704968 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:10.704713    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cf17f62950883f1c8a107833dad70863a8e0d43f43b11aa0014f5f3affae8cf"
Oct 30 22:41:10.989656 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:10.989539    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:12.310369 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:12.310316    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:13.160371 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:41:13.160325    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:41:17.395655 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:17.395583    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:17.917140 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:17.917103    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"]
Oct 30 22:41:18.025853 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:18.025811    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"]
Oct 30 22:41:18.378207 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:18.378172    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:18.621950 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:18.621918    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:21.840630 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:21.840584    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"]
Oct 30 22:41:21.841068 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:21.841054    5258 cpu_manager.go:414] "containerMap: removing container" podUID="d80e7d11-8916-41ea-b11c-b69b5e40a4fc" containerName="revoke-keys"
Oct 30 22:41:21.841116 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:21.841069    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d80e7d11-8916-41ea-b11c-b69b5e40a4fc" containerName="revoke-keys"
Oct 30 22:41:21.841173 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:21.841164    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="d80e7d11-8916-41ea-b11c-b69b5e40a4fc" containerName="revoke-keys"
Oct 30 22:41:21.844290 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:21.844272    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"
Oct 30 22:41:21.898404 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:21.898378    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:41:21.945965 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:21.945936    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:41:21.945965 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:21.945957    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:41:21.946151 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:21.946090    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l4mjj\""
Oct 30 22:41:21.949091 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:21.949076    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"]
Oct 30 22:41:21.949462 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:21.949443    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/996258de-38f8-4634-8f6e-e28508400135-maas-api-xks-ca\") pod \"maas-api-revoke-sub-459c11f3-xxl28\" (UID: \"996258de-38f8-4634-8f6e-e28508400135\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"
Oct 30 22:41:21.949504 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:21.949489    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/996258de-38f8-4634-8f6e-e28508400135-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-459c11f3-xxl28\" (UID: \"996258de-38f8-4634-8f6e-e28508400135\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"
Oct 30 22:41:21.949585 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:21.949573    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7f8b\" (UniqueName: \"kubernetes.io/projected/996258de-38f8-4634-8f6e-e28508400135-kube-api-access-g7f8b\") pod \"maas-api-revoke-sub-459c11f3-xxl28\" (UID: \"996258de-38f8-4634-8f6e-e28508400135\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"
Oct 30 22:41:22.050717 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:22.050682    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/996258de-38f8-4634-8f6e-e28508400135-maas-api-xks-ca\") pod \"maas-api-revoke-sub-459c11f3-xxl28\" (UID: \"996258de-38f8-4634-8f6e-e28508400135\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"
Oct 30 22:41:22.050880 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:22.050753    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/996258de-38f8-4634-8f6e-e28508400135-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-459c11f3-xxl28\" (UID: \"996258de-38f8-4634-8f6e-e28508400135\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"
Oct 30 22:41:22.050880 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:22.050820    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7f8b\" (UniqueName: \"kubernetes.io/projected/996258de-38f8-4634-8f6e-e28508400135-kube-api-access-g7f8b\") pod \"maas-api-revoke-sub-459c11f3-xxl28\" (UID: \"996258de-38f8-4634-8f6e-e28508400135\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"
Oct 30 22:41:22.051491 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:22.051466    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/996258de-38f8-4634-8f6e-e28508400135-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-459c11f3-xxl28\" (UID: \"996258de-38f8-4634-8f6e-e28508400135\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"
Oct 30 22:41:22.053107 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:22.053079    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/996258de-38f8-4634-8f6e-e28508400135-maas-api-xks-ca\") pod \"maas-api-revoke-sub-459c11f3-xxl28\" (UID: \"996258de-38f8-4634-8f6e-e28508400135\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"
Oct 30 22:41:22.115403 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:22.115335    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7f8b\" (UniqueName: \"kubernetes.io/projected/996258de-38f8-4634-8f6e-e28508400135-kube-api-access-g7f8b\") pod \"maas-api-revoke-sub-459c11f3-xxl28\" (UID: \"996258de-38f8-4634-8f6e-e28508400135\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"
Oct 30 22:41:22.157144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:22.157116    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"
Oct 30 22:41:22.532712 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:22.532689    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"]
Oct 30 22:41:22.534751 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:41:22.534719    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod996258de_38f8_4634_8f6e_e28508400135.slice/crio-fdf9526b97652a2224f61ecbb2b5b074b50007765b93b72ff8bcdc2c97d60f52 WatchSource:0}: Error finding container fdf9526b97652a2224f61ecbb2b5b074b50007765b93b72ff8bcdc2c97d60f52: Status 404 returned error can't find the container with id fdf9526b97652a2224f61ecbb2b5b074b50007765b93b72ff8bcdc2c97d60f52
Oct 30 22:41:22.775437 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:22.775407    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28" event={"ID":"996258de-38f8-4634-8f6e-e28508400135","Type":"ContainerStarted","Data":"fdf9526b97652a2224f61ecbb2b5b074b50007765b93b72ff8bcdc2c97d60f52"}
Oct 30 22:41:22.918244 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:22.918204    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr" podUID="c543de65-55b8-44f8-914c-53a1e19cec44" containerName="payload-processing" containerID="cri-o://e2b75694363ba71ddb9056e73333f84ee496bd28613b3d38a3ff3d182d0b4446" gracePeriod=25
Oct 30 22:41:23.027086 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.027034    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7" podUID="6d58c008-7506-4ab0-9caa-1c57367f9f63" containerName="payload-pre-processing" containerID="cri-o://944c43d0628d522e8e98a0156ee279a1f7f8409bf2db6be9ae6b998f81a58959" gracePeriod=25
Oct 30 22:41:23.178922 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.178896    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"
Oct 30 22:41:23.263413 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.263380    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c543de65-55b8-44f8-914c-53a1e19cec44-kube-api-access-cjzlp\" (UniqueName: \"kubernetes.io/projected/c543de65-55b8-44f8-914c-53a1e19cec44-kube-api-access-cjzlp\") pod \"c543de65-55b8-44f8-914c-53a1e19cec44\" (UID: \"c543de65-55b8-44f8-914c-53a1e19cec44\") "
Oct 30 22:41:23.263563 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.263508    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c543de65-55b8-44f8-914c-53a1e19cec44-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c543de65-55b8-44f8-914c-53a1e19cec44-plugins-config-volume\") pod \"c543de65-55b8-44f8-914c-53a1e19cec44\" (UID: \"c543de65-55b8-44f8-914c-53a1e19cec44\") "
Oct 30 22:41:23.263915 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.263891    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c543de65-55b8-44f8-914c-53a1e19cec44-plugins-config-volume" pod "c543de65-55b8-44f8-914c-53a1e19cec44" (UID: "c543de65-55b8-44f8-914c-53a1e19cec44"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:41:23.265500 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.265470    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c543de65-55b8-44f8-914c-53a1e19cec44-kube-api-access-cjzlp" pod "c543de65-55b8-44f8-914c-53a1e19cec44" (UID: "c543de65-55b8-44f8-914c-53a1e19cec44"). InnerVolumeSpecName "kube-api-access-cjzlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:41:23.286498 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.286479    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"
Oct 30 22:41:23.364166 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.364136    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6d58c008-7506-4ab0-9caa-1c57367f9f63-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d58c008-7506-4ab0-9caa-1c57367f9f63-plugins-config-volume\") pod \"6d58c008-7506-4ab0-9caa-1c57367f9f63\" (UID: \"6d58c008-7506-4ab0-9caa-1c57367f9f63\") "
Oct 30 22:41:23.364352 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.364331    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6d58c008-7506-4ab0-9caa-1c57367f9f63-kube-api-access-nxtqd\" (UniqueName: \"kubernetes.io/projected/6d58c008-7506-4ab0-9caa-1c57367f9f63-kube-api-access-nxtqd\") pod \"6d58c008-7506-4ab0-9caa-1c57367f9f63\" (UID: \"6d58c008-7506-4ab0-9caa-1c57367f9f63\") "
Oct 30 22:41:23.364561 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.364540    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d58c008-7506-4ab0-9caa-1c57367f9f63-plugins-config-volume" pod "6d58c008-7506-4ab0-9caa-1c57367f9f63" (UID: "6d58c008-7506-4ab0-9caa-1c57367f9f63"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:41:23.364691 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.364676    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjzlp\" (UniqueName: \"kubernetes.io/projected/c543de65-55b8-44f8-914c-53a1e19cec44-kube-api-access-cjzlp\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:23.364759 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.364693    5258 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c543de65-55b8-44f8-914c-53a1e19cec44-plugins-config-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:23.364759 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.364702    5258 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d58c008-7506-4ab0-9caa-1c57367f9f63-plugins-config-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:23.366422 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.366400    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d58c008-7506-4ab0-9caa-1c57367f9f63-kube-api-access-nxtqd" pod "6d58c008-7506-4ab0-9caa-1c57367f9f63" (UID: "6d58c008-7506-4ab0-9caa-1c57367f9f63"). InnerVolumeSpecName "kube-api-access-nxtqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:41:23.465868 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.465780    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxtqd\" (UniqueName: \"kubernetes.io/projected/6d58c008-7506-4ab0-9caa-1c57367f9f63-kube-api-access-nxtqd\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:23.784657 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.784550    5258 generic.go:356] "Generic (PLEG): container finished" podID="c543de65-55b8-44f8-914c-53a1e19cec44" containerID="e2b75694363ba71ddb9056e73333f84ee496bd28613b3d38a3ff3d182d0b4446" exitCode=0
Oct 30 22:41:23.784657 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.784610    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"
Oct 30 22:41:23.784657 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.784636    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr" event={"ID":"c543de65-55b8-44f8-914c-53a1e19cec44","Type":"ContainerDied","Data":"e2b75694363ba71ddb9056e73333f84ee496bd28613b3d38a3ff3d182d0b4446"}
Oct 30 22:41:23.784916 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.784689    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr" event={"ID":"c543de65-55b8-44f8-914c-53a1e19cec44","Type":"ContainerDied","Data":"e697d9f39f1492c184ba0a13ff8ddb848809538fa0603d651243ed13641eebcb"}
Oct 30 22:41:23.784916 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.784713    5258 scope.go:122] "RemoveContainer" containerID="e2b75694363ba71ddb9056e73333f84ee496bd28613b3d38a3ff3d182d0b4446"
Oct 30 22:41:23.786400 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.786375    5258 generic.go:356] "Generic (PLEG): container finished" podID="6d58c008-7506-4ab0-9caa-1c57367f9f63" containerID="944c43d0628d522e8e98a0156ee279a1f7f8409bf2db6be9ae6b998f81a58959" exitCode=0
Oct 30 22:41:23.786544 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.786426    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"
Oct 30 22:41:23.786544 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.786461    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7" event={"ID":"6d58c008-7506-4ab0-9caa-1c57367f9f63","Type":"ContainerDied","Data":"944c43d0628d522e8e98a0156ee279a1f7f8409bf2db6be9ae6b998f81a58959"}
Oct 30 22:41:23.786544 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.786513    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7" event={"ID":"6d58c008-7506-4ab0-9caa-1c57367f9f63","Type":"ContainerDied","Data":"8ff2f6d075b0d5952b875294540f97206142d1e686f2898b124564d649b34187"}
Oct 30 22:41:23.788475 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.788439    5258 generic.go:356] "Generic (PLEG): container finished" podID="996258de-38f8-4634-8f6e-e28508400135" containerID="ee2da63f60bce0e3f0b0ec5af79590da4a2f0fc1604094fad11449912fa3c3b6" exitCode=0
Oct 30 22:41:23.788475 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.788469    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28" event={"ID":"996258de-38f8-4634-8f6e-e28508400135","Type":"ContainerDied","Data":"ee2da63f60bce0e3f0b0ec5af79590da4a2f0fc1604094fad11449912fa3c3b6"}
Oct 30 22:41:23.795477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.795462    5258 scope.go:122] "RemoveContainer" containerID="e2b75694363ba71ddb9056e73333f84ee496bd28613b3d38a3ff3d182d0b4446"
Oct 30 22:41:23.795765 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:41:23.795745    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2b75694363ba71ddb9056e73333f84ee496bd28613b3d38a3ff3d182d0b4446\": container with ID starting with e2b75694363ba71ddb9056e73333f84ee496bd28613b3d38a3ff3d182d0b4446 not found: ID does not exist" containerID="e2b75694363ba71ddb9056e73333f84ee496bd28613b3d38a3ff3d182d0b4446"
Oct 30 22:41:23.795817 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.795772    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2b75694363ba71ddb9056e73333f84ee496bd28613b3d38a3ff3d182d0b4446"} err="failed to get container status \"e2b75694363ba71ddb9056e73333f84ee496bd28613b3d38a3ff3d182d0b4446\": rpc error: code = NotFound desc = could not find container \"e2b75694363ba71ddb9056e73333f84ee496bd28613b3d38a3ff3d182d0b4446\": container with ID starting with e2b75694363ba71ddb9056e73333f84ee496bd28613b3d38a3ff3d182d0b4446 not found: ID does not exist"
Oct 30 22:41:23.795817 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.795787    5258 scope.go:122] "RemoveContainer" containerID="944c43d0628d522e8e98a0156ee279a1f7f8409bf2db6be9ae6b998f81a58959"
Oct 30 22:41:23.804025 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.804005    5258 scope.go:122] "RemoveContainer" containerID="944c43d0628d522e8e98a0156ee279a1f7f8409bf2db6be9ae6b998f81a58959"
Oct 30 22:41:23.804281 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:41:23.804263    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"944c43d0628d522e8e98a0156ee279a1f7f8409bf2db6be9ae6b998f81a58959\": container with ID starting with 944c43d0628d522e8e98a0156ee279a1f7f8409bf2db6be9ae6b998f81a58959 not found: ID does not exist" containerID="944c43d0628d522e8e98a0156ee279a1f7f8409bf2db6be9ae6b998f81a58959"
Oct 30 22:41:23.804335 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:23.804287    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"944c43d0628d522e8e98a0156ee279a1f7f8409bf2db6be9ae6b998f81a58959"} err="failed to get container status \"944c43d0628d522e8e98a0156ee279a1f7f8409bf2db6be9ae6b998f81a58959\": rpc error: code = NotFound desc = could not find container \"944c43d0628d522e8e98a0156ee279a1f7f8409bf2db6be9ae6b998f81a58959\": container with ID starting with 944c43d0628d522e8e98a0156ee279a1f7f8409bf2db6be9ae6b998f81a58959 not found: ID does not exist"
Oct 30 22:41:24.073204 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:24.073169    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"]
Oct 30 22:41:24.076479 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:24.076452    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-c76d9e-7f8cf9f57f-vwgpr"]
Oct 30 22:41:24.187172 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:24.187140    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"]
Oct 30 22:41:24.191667 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:24.191638    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-c76d9e-689dbf5d7-pn7m7"]
Oct 30 22:41:24.939808 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:24.939780    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"
Oct 30 22:41:25.081790 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:25.081754    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/996258de-38f8-4634-8f6e-e28508400135-kube-api-access-g7f8b\" (UniqueName: \"kubernetes.io/projected/996258de-38f8-4634-8f6e-e28508400135-kube-api-access-g7f8b\") pod \"996258de-38f8-4634-8f6e-e28508400135\" (UID: \"996258de-38f8-4634-8f6e-e28508400135\") "
Oct 30 22:41:25.082320 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:25.081834    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/996258de-38f8-4634-8f6e-e28508400135-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/996258de-38f8-4634-8f6e-e28508400135-maas-api-xks-ca\") pod \"996258de-38f8-4634-8f6e-e28508400135\" (UID: \"996258de-38f8-4634-8f6e-e28508400135\") "
Oct 30 22:41:25.082320 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:25.081937    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/996258de-38f8-4634-8f6e-e28508400135-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/996258de-38f8-4634-8f6e-e28508400135-maas-api-openshift-ca\") pod \"996258de-38f8-4634-8f6e-e28508400135\" (UID: \"996258de-38f8-4634-8f6e-e28508400135\") "
Oct 30 22:41:25.082634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:25.082572    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/996258de-38f8-4634-8f6e-e28508400135-maas-api-openshift-ca" pod "996258de-38f8-4634-8f6e-e28508400135" (UID: "996258de-38f8-4634-8f6e-e28508400135"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:41:25.084528 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:25.084501    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/996258de-38f8-4634-8f6e-e28508400135-maas-api-xks-ca" pod "996258de-38f8-4634-8f6e-e28508400135" (UID: "996258de-38f8-4634-8f6e-e28508400135"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:41:25.084751 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:25.084728    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/996258de-38f8-4634-8f6e-e28508400135-kube-api-access-g7f8b" pod "996258de-38f8-4634-8f6e-e28508400135" (UID: "996258de-38f8-4634-8f6e-e28508400135"). InnerVolumeSpecName "kube-api-access-g7f8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:41:25.182791 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:25.182757    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/996258de-38f8-4634-8f6e-e28508400135-maas-api-openshift-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:25.182791 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:25.182785    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7f8b\" (UniqueName: \"kubernetes.io/projected/996258de-38f8-4634-8f6e-e28508400135-kube-api-access-g7f8b\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:25.182791 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:25.182796    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/996258de-38f8-4634-8f6e-e28508400135-maas-api-xks-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:25.380092 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:25.380003    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6d58c008-7506-4ab0-9caa-1c57367f9f63" path="/var/lib/kubelet/pods/6d58c008-7506-4ab0-9caa-1c57367f9f63/volumes"
Oct 30 22:41:25.380390 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:25.380376    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c543de65-55b8-44f8-914c-53a1e19cec44" path="/var/lib/kubelet/pods/c543de65-55b8-44f8-914c-53a1e19cec44/volumes"
Oct 30 22:41:25.803726 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:25.803615    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"
Oct 30 22:41:25.803726 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:25.803649    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28" event={"ID":"996258de-38f8-4634-8f6e-e28508400135","Type":"ContainerDied","Data":"fdf9526b97652a2224f61ecbb2b5b074b50007765b93b72ff8bcdc2c97d60f52"}
Oct 30 22:41:25.803915 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:25.803747    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdf9526b97652a2224f61ecbb2b5b074b50007765b93b72ff8bcdc2c97d60f52"
Oct 30 22:41:31.670656 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:31.670616    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:35.974023 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:35.973984    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:37.399933 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:37.399892    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:38.906398 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:38.906359    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:41:39.006974 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:39.006944    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:39.301443 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:39.301359    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:39.458585 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:39.458551    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"]
Oct 30 22:41:39.508180 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:39.508150    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w6-c76d9e-xh8dd"]
Oct 30 22:41:39.974411 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:39.974376    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:41.382112 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:41.382076    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d80e7d11-8916-41ea-b11c-b69b5e40a4fc" path="/var/lib/kubelet/pods/d80e7d11-8916-41ea-b11c-b69b5e40a4fc/volumes"
Oct 30 22:41:43.160636 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:41:43.160584    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:41:47.597463 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:47.597420    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"]
Oct 30 22:41:47.597970 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:47.597670    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn" podUID="825006b6-171c-4fcb-9dbd-b875d8abbca2" containerName="istio-proxy" containerID="cri-o://ff22299e9ec1fd859478ade447070ac03bc5ae600eda6e8bea03eaf975a2d92b" gracePeriod=30
Oct 30 22:41:47.804454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:47.804414    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:48.067058 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:48.067026    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:49.531913 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:49.531876    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:49.770929 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:49.770881    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:49.996795 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:49.996523    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:51.115391 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:51.115355    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:52.398996 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.398961    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:41:52.617431 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.617400    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vc8jn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:41:52.617579 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.617458    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn" podUID="825006b6-171c-4fcb-9dbd-b875d8abbca2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:41:52.865987 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.865962    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:41:52.967063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.966979    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-podinfo\") pod \"825006b6-171c-4fcb-9dbd-b875d8abbca2\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") "
Oct 30 22:41:52.967063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.967030    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-credential-socket\") pod \"825006b6-171c-4fcb-9dbd-b875d8abbca2\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") "
Oct 30 22:41:52.967303 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.967074    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-workload-certs\") pod \"825006b6-171c-4fcb-9dbd-b875d8abbca2\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") "
Oct 30 22:41:52.967303 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.967106    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-data\") pod \"825006b6-171c-4fcb-9dbd-b875d8abbca2\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") "
Oct 30 22:41:52.967303 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.967142    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-envoy\") pod \"825006b6-171c-4fcb-9dbd-b875d8abbca2\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") "
Oct 30 22:41:52.967303 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.967162    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-workload-socket\") pod \"825006b6-171c-4fcb-9dbd-b875d8abbca2\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") "
Oct 30 22:41:52.967303 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.967190    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/825006b6-171c-4fcb-9dbd-b875d8abbca2-kube-api-access-h5rv8\" (UniqueName: \"kubernetes.io/projected/825006b6-171c-4fcb-9dbd-b875d8abbca2-kube-api-access-h5rv8\") pod \"825006b6-171c-4fcb-9dbd-b875d8abbca2\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") "
Oct 30 22:41:52.967585 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.967303    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-token\" (UniqueName: \"kubernetes.io/projected/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-token\") pod \"825006b6-171c-4fcb-9dbd-b875d8abbca2\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") "
Oct 30 22:41:52.967585 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.967342    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/825006b6-171c-4fcb-9dbd-b875d8abbca2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/825006b6-171c-4fcb-9dbd-b875d8abbca2-istiod-ca-cert\") pod \"825006b6-171c-4fcb-9dbd-b875d8abbca2\" (UID: \"825006b6-171c-4fcb-9dbd-b875d8abbca2\") "
Oct 30 22:41:52.967585 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.967344    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-credential-socket" pod "825006b6-171c-4fcb-9dbd-b875d8abbca2" (UID: "825006b6-171c-4fcb-9dbd-b875d8abbca2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:41:52.967585 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.967506    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-workload-socket" pod "825006b6-171c-4fcb-9dbd-b875d8abbca2" (UID: "825006b6-171c-4fcb-9dbd-b875d8abbca2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:41:52.967874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.967617    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-workload-certs" pod "825006b6-171c-4fcb-9dbd-b875d8abbca2" (UID: "825006b6-171c-4fcb-9dbd-b875d8abbca2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:41:52.967874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.967775    5258 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-credential-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:52.967874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.967797    5258 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-workload-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:52.967874 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.967812    5258 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-workload-socket\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:52.968245 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.968219    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/825006b6-171c-4fcb-9dbd-b875d8abbca2-istiod-ca-cert" pod "825006b6-171c-4fcb-9dbd-b875d8abbca2" (UID: "825006b6-171c-4fcb-9dbd-b875d8abbca2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:41:52.968338 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.968326    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-data" pod "825006b6-171c-4fcb-9dbd-b875d8abbca2" (UID: "825006b6-171c-4fcb-9dbd-b875d8abbca2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:41:52.969934 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.969903    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-podinfo" pod "825006b6-171c-4fcb-9dbd-b875d8abbca2" (UID: "825006b6-171c-4fcb-9dbd-b875d8abbca2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:41:52.970050 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.969975    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-token" pod "825006b6-171c-4fcb-9dbd-b875d8abbca2" (UID: "825006b6-171c-4fcb-9dbd-b875d8abbca2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:41:52.970050 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.970015    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-envoy" pod "825006b6-171c-4fcb-9dbd-b875d8abbca2" (UID: "825006b6-171c-4fcb-9dbd-b875d8abbca2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:41:52.970158 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.970134    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/825006b6-171c-4fcb-9dbd-b875d8abbca2-kube-api-access-h5rv8" pod "825006b6-171c-4fcb-9dbd-b875d8abbca2" (UID: "825006b6-171c-4fcb-9dbd-b875d8abbca2"). InnerVolumeSpecName "kube-api-access-h5rv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:41:52.970912 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.970884    5258 generic.go:356] "Generic (PLEG): container finished" podID="825006b6-171c-4fcb-9dbd-b875d8abbca2" containerID="ff22299e9ec1fd859478ade447070ac03bc5ae600eda6e8bea03eaf975a2d92b" exitCode=0
Oct 30 22:41:52.971018 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.970941    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"
Oct 30 22:41:52.971018 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.970948    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn" event={"ID":"825006b6-171c-4fcb-9dbd-b875d8abbca2","Type":"ContainerDied","Data":"ff22299e9ec1fd859478ade447070ac03bc5ae600eda6e8bea03eaf975a2d92b"}
Oct 30 22:41:52.971106 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.971023    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn" event={"ID":"825006b6-171c-4fcb-9dbd-b875d8abbca2","Type":"ContainerDied","Data":"bfc7ff7303ef4f2be91098a44890c108d9e00e9b1e0916cb24f71dfc89f896b9"}
Oct 30 22:41:52.971106 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.971058    5258 scope.go:122] "RemoveContainer" containerID="ff22299e9ec1fd859478ade447070ac03bc5ae600eda6e8bea03eaf975a2d92b"
Oct 30 22:41:52.992758 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.992740    5258 scope.go:122] "RemoveContainer" containerID="ff22299e9ec1fd859478ade447070ac03bc5ae600eda6e8bea03eaf975a2d92b"
Oct 30 22:41:52.993045 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:41:52.993024    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff22299e9ec1fd859478ade447070ac03bc5ae600eda6e8bea03eaf975a2d92b\": container with ID starting with ff22299e9ec1fd859478ade447070ac03bc5ae600eda6e8bea03eaf975a2d92b not found: ID does not exist" containerID="ff22299e9ec1fd859478ade447070ac03bc5ae600eda6e8bea03eaf975a2d92b"
Oct 30 22:41:52.993095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:52.993057    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff22299e9ec1fd859478ade447070ac03bc5ae600eda6e8bea03eaf975a2d92b"} err="failed to get container status \"ff22299e9ec1fd859478ade447070ac03bc5ae600eda6e8bea03eaf975a2d92b\": rpc error: code = NotFound desc = could not find container \"ff22299e9ec1fd859478ade447070ac03bc5ae600eda6e8bea03eaf975a2d92b\": container with ID starting with ff22299e9ec1fd859478ade447070ac03bc5ae600eda6e8bea03eaf975a2d92b not found: ID does not exist"
Oct 30 22:41:53.068806 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:53.068776    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5rv8\" (UniqueName: \"kubernetes.io/projected/825006b6-171c-4fcb-9dbd-b875d8abbca2-kube-api-access-h5rv8\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:53.068806 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:53.068802    5258 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-token\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:53.068982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:53.068814    5258 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/825006b6-171c-4fcb-9dbd-b875d8abbca2-istiod-ca-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:53.068982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:53.068830    5258 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-podinfo\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:53.068982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:53.068842    5258 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-data\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:53.068982 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:53.068851    5258 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/825006b6-171c-4fcb-9dbd-b875d8abbca2-istio-envoy\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:41:53.150840 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:53.150798    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"]
Oct 30 22:41:53.157079 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:53.157048    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vc8jn"]
Oct 30 22:41:53.383357 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:53.383320    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="825006b6-171c-4fcb-9dbd-b875d8abbca2" path="/var/lib/kubelet/pods/825006b6-171c-4fcb-9dbd-b875d8abbca2/volumes"
Oct 30 22:41:57.034528 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.034495    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-687b4b7474-kpgck"]
Oct 30 22:41:57.035032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.034931    5258 cpu_manager.go:414] "containerMap: removing container" podUID="996258de-38f8-4634-8f6e-e28508400135" containerName="revoke-keys"
Oct 30 22:41:57.035032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.034944    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="996258de-38f8-4634-8f6e-e28508400135" containerName="revoke-keys"
Oct 30 22:41:57.035032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.034963    5258 cpu_manager.go:414] "containerMap: removing container" podUID="6d58c008-7506-4ab0-9caa-1c57367f9f63" containerName="payload-pre-processing"
Oct 30 22:41:57.035032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.034968    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d58c008-7506-4ab0-9caa-1c57367f9f63" containerName="payload-pre-processing"
Oct 30 22:41:57.035032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.034981    5258 cpu_manager.go:414] "containerMap: removing container" podUID="c543de65-55b8-44f8-914c-53a1e19cec44" containerName="payload-processing"
Oct 30 22:41:57.035032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.034986    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c543de65-55b8-44f8-914c-53a1e19cec44" containerName="payload-processing"
Oct 30 22:41:57.035032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.034992    5258 cpu_manager.go:414] "containerMap: removing container" podUID="825006b6-171c-4fcb-9dbd-b875d8abbca2" containerName="istio-proxy"
Oct 30 22:41:57.035032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.034997    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="825006b6-171c-4fcb-9dbd-b875d8abbca2" containerName="istio-proxy"
Oct 30 22:41:57.035486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.035057    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="c543de65-55b8-44f8-914c-53a1e19cec44" containerName="payload-processing"
Oct 30 22:41:57.035486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.035064    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="825006b6-171c-4fcb-9dbd-b875d8abbca2" containerName="istio-proxy"
Oct 30 22:41:57.035486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.035076    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="996258de-38f8-4634-8f6e-e28508400135" containerName="revoke-keys"
Oct 30 22:41:57.035486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.035085    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d58c008-7506-4ab0-9caa-1c57367f9f63" containerName="payload-pre-processing"
Oct 30 22:41:57.039513 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.039492    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:41:57.103477 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.103448    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a774df21-def1-408b-b23d-e9d6f789232c-metrics-certs\") pod \"maas-controller-687b4b7474-kpgck\" (UID: \"a774df21-def1-408b-b23d-e9d6f789232c\") " pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:41:57.103649 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.103494    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a774df21-def1-408b-b23d-e9d6f789232c-webhook-cert\") pod \"maas-controller-687b4b7474-kpgck\" (UID: \"a774df21-def1-408b-b23d-e9d6f789232c\") " pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:41:57.103736 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.103669    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9g58\" (UniqueName: \"kubernetes.io/projected/a774df21-def1-408b-b23d-e9d6f789232c-kube-api-access-w9g58\") pod \"maas-controller-687b4b7474-kpgck\" (UID: \"a774df21-def1-408b-b23d-e9d6f789232c\") " pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:41:57.141858 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.141830    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 22:41:57.141858 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.141847    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 22:41:57.141858 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.141830    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fstvf\""
Oct 30 22:41:57.142053 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.141912    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 22:41:57.146013 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.145991    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-687b4b7474-kpgck"]
Oct 30 22:41:57.204737 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.204707    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a774df21-def1-408b-b23d-e9d6f789232c-metrics-certs\") pod \"maas-controller-687b4b7474-kpgck\" (UID: \"a774df21-def1-408b-b23d-e9d6f789232c\") " pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:41:57.204908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.204764    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a774df21-def1-408b-b23d-e9d6f789232c-webhook-cert\") pod \"maas-controller-687b4b7474-kpgck\" (UID: \"a774df21-def1-408b-b23d-e9d6f789232c\") " pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:41:57.204908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.204834    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9g58\" (UniqueName: \"kubernetes.io/projected/a774df21-def1-408b-b23d-e9d6f789232c-kube-api-access-w9g58\") pod \"maas-controller-687b4b7474-kpgck\" (UID: \"a774df21-def1-408b-b23d-e9d6f789232c\") " pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:41:57.207237 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.207195    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a774df21-def1-408b-b23d-e9d6f789232c-metrics-certs\") pod \"maas-controller-687b4b7474-kpgck\" (UID: \"a774df21-def1-408b-b23d-e9d6f789232c\") " pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:41:57.207361 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.207270    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a774df21-def1-408b-b23d-e9d6f789232c-webhook-cert\") pod \"maas-controller-687b4b7474-kpgck\" (UID: \"a774df21-def1-408b-b23d-e9d6f789232c\") " pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:41:57.266957 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.266933    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9g58\" (UniqueName: \"kubernetes.io/projected/a774df21-def1-408b-b23d-e9d6f789232c-kube-api-access-w9g58\") pod \"maas-controller-687b4b7474-kpgck\" (UID: \"a774df21-def1-408b-b23d-e9d6f789232c\") " pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:41:57.353133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.353102    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:41:57.737973 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.737940    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-687b4b7474-kpgck"]
Oct 30 22:41:57.740292 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:41:57.740264    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda774df21_def1_408b_b23d_e9d6f789232c.slice/crio-02163f93b7358df61052179fab8cb137dc64b3327e8a11a581777d410eb78a27 WatchSource:0}: Error finding container 02163f93b7358df61052179fab8cb137dc64b3327e8a11a581777d410eb78a27: Status 404 returned error can't find the container with id 02163f93b7358df61052179fab8cb137dc64b3327e8a11a581777d410eb78a27
Oct 30 22:41:57.741501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.741483    5258 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:41:57.999983 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:57.999905    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687b4b7474-kpgck" event={"ID":"a774df21-def1-408b-b23d-e9d6f789232c","Type":"ContainerStarted","Data":"02163f93b7358df61052179fab8cb137dc64b3327e8a11a581777d410eb78a27"}
Oct 30 22:41:58.477848 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:58.477808    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:59.008856 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:59.008815    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687b4b7474-kpgck" event={"ID":"a774df21-def1-408b-b23d-e9d6f789232c","Type":"ContainerStarted","Data":"1c100bd8fd8bc9fd23e19302bea4a34e8a28692e4eb9d4b028aa886f07842401"}
Oct 30 22:41:59.009075 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:59.009058    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:41:59.137808 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:41:59.137738    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-687b4b7474-kpgck" podStartSLOduration=2.276317404 podStartE2EDuration="3.137719163s" totalImagesPullingTime="861.401759ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:41:59.133606001 +0000 UTC m=+2833.864463144" watchObservedRunningTime="2026-10-30 22:41:59.137719163 +0000 UTC m=+2833.868576306"
Oct 30 22:42:10.019824 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:10.019791    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:42:13.159153 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:42:13.159115    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:42:27.626154 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:27.626114    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:42:27.920186 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:27.920095    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:42:31.059357 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.059323    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:42:31.082614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.082550    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-687b4b7474-kpgck"]
Oct 30 22:42:31.082771 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.082743    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-687b4b7474-kpgck" podUID="a774df21-def1-408b-b23d-e9d6f789232c" containerName="manager" containerID="cri-o://1c100bd8fd8bc9fd23e19302bea4a34e8a28692e4eb9d4b028aa886f07842401" gracePeriod=30
Oct 30 22:42:31.207938 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.207903    5258 generic.go:356] "Generic (PLEG): container finished" podID="a774df21-def1-408b-b23d-e9d6f789232c" containerID="1c100bd8fd8bc9fd23e19302bea4a34e8a28692e4eb9d4b028aa886f07842401" exitCode=0
Oct 30 22:42:31.208049 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.207946    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687b4b7474-kpgck" event={"ID":"a774df21-def1-408b-b23d-e9d6f789232c","Type":"ContainerDied","Data":"1c100bd8fd8bc9fd23e19302bea4a34e8a28692e4eb9d4b028aa886f07842401"}
Oct 30 22:42:31.328573 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.328545    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:42:31.413609 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.413557    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a774df21-def1-408b-b23d-e9d6f789232c-webhook-cert\" (UniqueName: \"kubernetes.io/secret/a774df21-def1-408b-b23d-e9d6f789232c-webhook-cert\") pod \"a774df21-def1-408b-b23d-e9d6f789232c\" (UID: \"a774df21-def1-408b-b23d-e9d6f789232c\") "
Oct 30 22:42:31.413758 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.413683    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a774df21-def1-408b-b23d-e9d6f789232c-kube-api-access-w9g58\" (UniqueName: \"kubernetes.io/projected/a774df21-def1-408b-b23d-e9d6f789232c-kube-api-access-w9g58\") pod \"a774df21-def1-408b-b23d-e9d6f789232c\" (UID: \"a774df21-def1-408b-b23d-e9d6f789232c\") "
Oct 30 22:42:31.415530 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.415503    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a774df21-def1-408b-b23d-e9d6f789232c-webhook-cert" pod "a774df21-def1-408b-b23d-e9d6f789232c" (UID: "a774df21-def1-408b-b23d-e9d6f789232c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:42:31.415684 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.415668    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a774df21-def1-408b-b23d-e9d6f789232c-kube-api-access-w9g58" pod "a774df21-def1-408b-b23d-e9d6f789232c" (UID: "a774df21-def1-408b-b23d-e9d6f789232c"). InnerVolumeSpecName "kube-api-access-w9g58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:42:31.514684 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.514653    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a774df21-def1-408b-b23d-e9d6f789232c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a774df21-def1-408b-b23d-e9d6f789232c-metrics-certs\") pod \"a774df21-def1-408b-b23d-e9d6f789232c\" (UID: \"a774df21-def1-408b-b23d-e9d6f789232c\") "
Oct 30 22:42:31.515043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.514910    5258 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a774df21-def1-408b-b23d-e9d6f789232c-webhook-cert\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:42:31.515043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.514925    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9g58\" (UniqueName: \"kubernetes.io/projected/a774df21-def1-408b-b23d-e9d6f789232c-kube-api-access-w9g58\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:42:31.516680 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.516650    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a774df21-def1-408b-b23d-e9d6f789232c-metrics-certs" pod "a774df21-def1-408b-b23d-e9d6f789232c" (UID: "a774df21-def1-408b-b23d-e9d6f789232c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:42:31.615713 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:31.615642    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a774df21-def1-408b-b23d-e9d6f789232c-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:42:32.015519 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:32.015428    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:42:32.214474 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:32.214441    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687b4b7474-kpgck" event={"ID":"a774df21-def1-408b-b23d-e9d6f789232c","Type":"ContainerDied","Data":"02163f93b7358df61052179fab8cb137dc64b3327e8a11a581777d410eb78a27"}
Oct 30 22:42:32.214917 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:32.214504    5258 scope.go:122] "RemoveContainer" containerID="1c100bd8fd8bc9fd23e19302bea4a34e8a28692e4eb9d4b028aa886f07842401"
Oct 30 22:42:32.214917 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:32.214451    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687b4b7474-kpgck"
Oct 30 22:42:32.387816 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:32.387786    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-687b4b7474-kpgck"]
Oct 30 22:42:32.402382 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:32.402354    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-687b4b7474-kpgck"]
Oct 30 22:42:33.008229 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.008193    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"]
Oct 30 22:42:33.008766 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.008746    5258 cpu_manager.go:414] "containerMap: removing container" podUID="a774df21-def1-408b-b23d-e9d6f789232c" containerName="manager"
Oct 30 22:42:33.008823 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.008767    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a774df21-def1-408b-b23d-e9d6f789232c" containerName="manager"
Oct 30 22:42:33.008863 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.008854    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="a774df21-def1-408b-b23d-e9d6f789232c" containerName="manager"
Oct 30 22:42:33.013196 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.013175    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.027993 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.027964    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mkmc\" (UniqueName: \"kubernetes.io/projected/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-kube-api-access-5mkmc\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.028101 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.028004    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.028147 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.028119    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.028190 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.028148    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.028190 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.028174    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.028322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.028305    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.028384 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.028365    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.028441 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.028393    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.028497 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.028462    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.113847 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.113816    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"]
Oct 30 22:42:33.129157 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.129130    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.129287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.129165    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.129287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.129186    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.129287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.129225    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.129287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.129275    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.129512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.129301    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.129512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.129336    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.129512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.129377    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mkmc\" (UniqueName: \"kubernetes.io/projected/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-kube-api-access-5mkmc\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.129512 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.129411    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.129746 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.129721    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.130040 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.130002    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.130146 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.130041    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.130146 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.130095    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.130242 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.130143    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.131635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.131609    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.131986 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.131960    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.191767 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.191741    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.191989 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.191963    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mkmc\" (UniqueName: \"kubernetes.io/projected/8c139cbd-4b47-41c0-b11f-742a3ff3f81b-kube-api-access-5mkmc\") pod \"maas-default-gateway-openshift-default-76597d6855-62dtc\" (UID: \"8c139cbd-4b47-41c0-b11f-742a3ff3f81b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.327069 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.327037    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:33.382337 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.382303    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a774df21-def1-408b-b23d-e9d6f789232c" path="/var/lib/kubelet/pods/a774df21-def1-408b-b23d-e9d6f789232c/volumes"
Oct 30 22:42:33.767895 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.767869    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"]
Oct 30 22:42:33.769731 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:42:33.769705    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c139cbd_4b47_41c0_b11f_742a3ff3f81b.slice/crio-72c68464597d8b214a6aa0fb52d5186e7d621dd12d2ca978e2eb70feae817ae8 WatchSource:0}: Error finding container 72c68464597d8b214a6aa0fb52d5186e7d621dd12d2ca978e2eb70feae817ae8: Status 404 returned error can't find the container with id 72c68464597d8b214a6aa0fb52d5186e7d621dd12d2ca978e2eb70feae817ae8
Oct 30 22:42:33.771313 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.771289    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:42:33.772349 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.772321    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:42:33.772430 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.772384    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:42:33.772430 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.772409    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:42:33.861411 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.861383    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-687b4b7474-nmhzz"]
Oct 30 22:42:33.865085 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.865066    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687b4b7474-nmhzz"
Oct 30 22:42:33.920006 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.919976    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 22:42:33.920132 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.920092    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fstvf\""
Oct 30 22:42:33.934416 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.934375    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 22:42:33.934416 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.934390    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 22:42:33.935910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.935889    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e900fb86-08e5-49bd-bb58-6e919e6588e0-metrics-certs\") pod \"maas-controller-687b4b7474-nmhzz\" (UID: \"e900fb86-08e5-49bd-bb58-6e919e6588e0\") " pod="opendatahub/maas-controller-687b4b7474-nmhzz"
Oct 30 22:42:33.935992 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.935931    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw6kk\" (UniqueName: \"kubernetes.io/projected/e900fb86-08e5-49bd-bb58-6e919e6588e0-kube-api-access-cw6kk\") pod \"maas-controller-687b4b7474-nmhzz\" (UID: \"e900fb86-08e5-49bd-bb58-6e919e6588e0\") " pod="opendatahub/maas-controller-687b4b7474-nmhzz"
Oct 30 22:42:33.936138 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.936118    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e900fb86-08e5-49bd-bb58-6e919e6588e0-webhook-cert\") pod \"maas-controller-687b4b7474-nmhzz\" (UID: \"e900fb86-08e5-49bd-bb58-6e919e6588e0\") " pod="opendatahub/maas-controller-687b4b7474-nmhzz"
Oct 30 22:42:33.970300 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:33.970273    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-687b4b7474-nmhzz"]
Oct 30 22:42:34.037229 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:34.037144    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e900fb86-08e5-49bd-bb58-6e919e6588e0-metrics-certs\") pod \"maas-controller-687b4b7474-nmhzz\" (UID: \"e900fb86-08e5-49bd-bb58-6e919e6588e0\") " pod="opendatahub/maas-controller-687b4b7474-nmhzz"
Oct 30 22:42:34.037229 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:34.037197    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw6kk\" (UniqueName: \"kubernetes.io/projected/e900fb86-08e5-49bd-bb58-6e919e6588e0-kube-api-access-cw6kk\") pod \"maas-controller-687b4b7474-nmhzz\" (UID: \"e900fb86-08e5-49bd-bb58-6e919e6588e0\") " pod="opendatahub/maas-controller-687b4b7474-nmhzz"
Oct 30 22:42:34.037423 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:34.037294    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e900fb86-08e5-49bd-bb58-6e919e6588e0-webhook-cert\") pod \"maas-controller-687b4b7474-nmhzz\" (UID: \"e900fb86-08e5-49bd-bb58-6e919e6588e0\") " pod="opendatahub/maas-controller-687b4b7474-nmhzz"
Oct 30 22:42:34.039721 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:34.039695    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e900fb86-08e5-49bd-bb58-6e919e6588e0-metrics-certs\") pod \"maas-controller-687b4b7474-nmhzz\" (UID: \"e900fb86-08e5-49bd-bb58-6e919e6588e0\") " pod="opendatahub/maas-controller-687b4b7474-nmhzz"
Oct 30 22:42:34.039901 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:34.039881    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e900fb86-08e5-49bd-bb58-6e919e6588e0-webhook-cert\") pod \"maas-controller-687b4b7474-nmhzz\" (UID: \"e900fb86-08e5-49bd-bb58-6e919e6588e0\") " pod="opendatahub/maas-controller-687b4b7474-nmhzz"
Oct 30 22:42:34.099727 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:34.099692    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw6kk\" (UniqueName: \"kubernetes.io/projected/e900fb86-08e5-49bd-bb58-6e919e6588e0-kube-api-access-cw6kk\") pod \"maas-controller-687b4b7474-nmhzz\" (UID: \"e900fb86-08e5-49bd-bb58-6e919e6588e0\") " pod="opendatahub/maas-controller-687b4b7474-nmhzz"
Oct 30 22:42:34.179041 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:34.179002    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687b4b7474-nmhzz"
Oct 30 22:42:34.251272 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:34.249897    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc" event={"ID":"8c139cbd-4b47-41c0-b11f-742a3ff3f81b","Type":"ContainerStarted","Data":"122bd38f191ab87034e80d26f617c32928f56922b5a0d53a78d82eaae1d052e8"}
Oct 30 22:42:34.251272 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:34.249970    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc" event={"ID":"8c139cbd-4b47-41c0-b11f-742a3ff3f81b","Type":"ContainerStarted","Data":"72c68464597d8b214a6aa0fb52d5186e7d621dd12d2ca978e2eb70feae817ae8"}
Oct 30 22:42:34.327563 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:34.327505    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:34.328697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:34.328671    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-62dtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 22:42:34.328821 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:34.328730    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc" podUID="8c139cbd-4b47-41c0-b11f-742a3ff3f81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 22:42:34.573614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:34.572761    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc" podStartSLOduration=2.572738141 podStartE2EDuration="2.572738141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:42:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:42:34.376626511 +0000 UTC m=+2869.107483655" watchObservedRunningTime="2026-10-30 22:42:34.572738141 +0000 UTC m=+2869.303595288"
Oct 30 22:42:34.576273 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:34.576218    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-687b4b7474-nmhzz"]
Oct 30 22:42:34.581144 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:42:34.581110    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode900fb86_08e5_49bd_bb58_6e919e6588e0.slice/crio-bd034b583dcae5840ae6c6ec91f834a4fef3ca02b2c5dce9b5e61ef066fb8c10 WatchSource:0}: Error finding container bd034b583dcae5840ae6c6ec91f834a4fef3ca02b2c5dce9b5e61ef066fb8c10: Status 404 returned error can't find the container with id bd034b583dcae5840ae6c6ec91f834a4fef3ca02b2c5dce9b5e61ef066fb8c10
Oct 30 22:42:35.261192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:35.261156    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687b4b7474-nmhzz" event={"ID":"e900fb86-08e5-49bd-bb58-6e919e6588e0","Type":"ContainerStarted","Data":"bd034b583dcae5840ae6c6ec91f834a4fef3ca02b2c5dce9b5e61ef066fb8c10"}
Oct 30 22:42:35.327860 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:35.327825    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-62dtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 22:42:35.328251 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:35.327877    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc" podUID="8c139cbd-4b47-41c0-b11f-742a3ff3f81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 22:42:36.272504 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:36.272465    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687b4b7474-nmhzz" event={"ID":"e900fb86-08e5-49bd-bb58-6e919e6588e0","Type":"ContainerStarted","Data":"8aeff2a7ab2ff0c041608b3950384acef13f0e0dfff55abe350a5fe932fbb252"}
Oct 30 22:42:36.273000 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:36.272982    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-687b4b7474-nmhzz"
Oct 30 22:42:36.328032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:36.328002    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-62dtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 22:42:36.328361 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:36.328053    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc" podUID="8c139cbd-4b47-41c0-b11f-742a3ff3f81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 22:42:36.434460 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:36.434407    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-687b4b7474-nmhzz" podStartSLOduration=2.540524615 podStartE2EDuration="3.434395345s" totalImagesPullingTime="893.87073ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:42:36.392386206 +0000 UTC m=+2871.123243350" watchObservedRunningTime="2026-10-30 22:42:36.434395345 +0000 UTC m=+2871.165252506"
Oct 30 22:42:37.327494 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:37.327458    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-62dtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 22:42:37.327697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:37.327519    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc" podUID="8c139cbd-4b47-41c0-b11f-742a3ff3f81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 22:42:38.328174 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:38.328140    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-62dtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 22:42:38.328620 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:38.328194    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc" podUID="8c139cbd-4b47-41c0-b11f-742a3ff3f81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 22:42:39.328139 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:39.328106    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-62dtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 22:42:39.328316 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:39.328165    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc" podUID="8c139cbd-4b47-41c0-b11f-742a3ff3f81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 22:42:40.328421 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:40.328383    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-62dtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused" start-of-body=
Oct 30 22:42:40.328827 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:40.328446    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc" podUID="8c139cbd-4b47-41c0-b11f-742a3ff3f81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": dial tcp 10.132.0.146:15021: connect: connection refused"
Oct 30 22:42:41.867608 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:41.867559    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:41.868140 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:41.868123    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:41.868861 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:41.868840    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc"
Oct 30 22:42:43.160911 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:42:43.160879    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:42:48.290213 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:48.290183    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-687b4b7474-nmhzz"
Oct 30 22:42:55.779195 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:55.779099    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:42:56.106833 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:42:56.106796    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:43:13.160332 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:43:13.160292    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:43:18.272975 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:18.272885    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:43:26.521079 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.521042    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:43:26.791335 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.791264    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"]
Oct 30 22:43:26.795112 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.795092    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"
Oct 30 22:43:26.819649 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.819626    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:43:26.848688 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.848667    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l4mjj\""
Oct 30 22:43:26.894658 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.894627    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv5xc\" (UniqueName: \"kubernetes.io/projected/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-kube-api-access-xv5xc\") pod \"maas-api-revoke-sub-c1e271a9-wvxcn\" (UID: \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"
Oct 30 22:43:26.894823 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.894802    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-wvxcn\" (UID: \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"
Oct 30 22:43:26.894877 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.894840    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-wvxcn\" (UID: \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"
Oct 30 22:43:26.898144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.898121    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:43:26.898257 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.898197    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:43:26.900812 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.900790    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"]
Oct 30 22:43:26.950072 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.950050    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:43:26.996296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.996269    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-wvxcn\" (UID: \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"
Oct 30 22:43:26.996380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.996305    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-wvxcn\" (UID: \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"
Oct 30 22:43:26.996380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.996344    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv5xc\" (UniqueName: \"kubernetes.io/projected/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-kube-api-access-xv5xc\") pod \"maas-api-revoke-sub-c1e271a9-wvxcn\" (UID: \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"
Oct 30 22:43:26.997037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.997014    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-wvxcn\" (UID: \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"
Oct 30 22:43:26.998573 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:26.998552    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-wvxcn\" (UID: \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"
Oct 30 22:43:27.058780 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:27.058758    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv5xc\" (UniqueName: \"kubernetes.io/projected/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-kube-api-access-xv5xc\") pod \"maas-api-revoke-sub-c1e271a9-wvxcn\" (UID: \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"
Oct 30 22:43:27.107359 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:27.107337    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"
Oct 30 22:43:27.498162 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:27.498138    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"]
Oct 30 22:43:27.500098 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:43:27.500070    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f537eb_7889_4cd8_a78d_96cb2bcab8d8.slice/crio-dea5bb86d95f2139856a7b378ed6cb8c9629c8f43f6516c03f0d23ac07690cc8 WatchSource:0}: Error finding container dea5bb86d95f2139856a7b378ed6cb8c9629c8f43f6516c03f0d23ac07690cc8: Status 404 returned error can't find the container with id dea5bb86d95f2139856a7b378ed6cb8c9629c8f43f6516c03f0d23ac07690cc8
Oct 30 22:43:27.578350 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:27.578323    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn" event={"ID":"12f537eb-7889-4cd8-a78d-96cb2bcab8d8","Type":"ContainerStarted","Data":"dea5bb86d95f2139856a7b378ed6cb8c9629c8f43f6516c03f0d23ac07690cc8"}
Oct 30 22:43:28.585907 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:28.585871    5258 generic.go:356] "Generic (PLEG): container finished" podID="12f537eb-7889-4cd8-a78d-96cb2bcab8d8" containerID="d36cb9ea6c23e6ccab5fd2c18f629a8ef7ed7b34dbb9d75c2d3c95096fffcf3f" exitCode=0
Oct 30 22:43:28.586405 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:28.585947    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn" event={"ID":"12f537eb-7889-4cd8-a78d-96cb2bcab8d8","Type":"ContainerDied","Data":"d36cb9ea6c23e6ccab5fd2c18f629a8ef7ed7b34dbb9d75c2d3c95096fffcf3f"}
Oct 30 22:43:29.737958 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:29.737936    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"
Oct 30 22:43:29.821761 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:29.821736    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-maas-api-openshift-ca\") pod \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\" (UID: \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\") "
Oct 30 22:43:29.821890 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:29.821797    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-maas-api-xks-ca\") pod \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\" (UID: \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\") "
Oct 30 22:43:29.821890 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:29.821821    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-kube-api-access-xv5xc\" (UniqueName: \"kubernetes.io/projected/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-kube-api-access-xv5xc\") pod \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\" (UID: \"12f537eb-7889-4cd8-a78d-96cb2bcab8d8\") "
Oct 30 22:43:29.822232 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:29.822199    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-maas-api-openshift-ca" pod "12f537eb-7889-4cd8-a78d-96cb2bcab8d8" (UID: "12f537eb-7889-4cd8-a78d-96cb2bcab8d8"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:43:29.823870 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:29.823847    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-maas-api-xks-ca" pod "12f537eb-7889-4cd8-a78d-96cb2bcab8d8" (UID: "12f537eb-7889-4cd8-a78d-96cb2bcab8d8"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:43:29.823870 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:29.823856    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-kube-api-access-xv5xc" pod "12f537eb-7889-4cd8-a78d-96cb2bcab8d8" (UID: "12f537eb-7889-4cd8-a78d-96cb2bcab8d8"). InnerVolumeSpecName "kube-api-access-xv5xc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:43:29.923192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:29.923120    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-maas-api-openshift-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:29.923192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:29.923149    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-maas-api-xks-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:29.923192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:29.923164    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xv5xc\" (UniqueName: \"kubernetes.io/projected/12f537eb-7889-4cd8-a78d-96cb2bcab8d8-kube-api-access-xv5xc\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:43:29.971008 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:29.970962    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:43:30.606212 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:30.606175    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"
Oct 30 22:43:30.606414 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:30.606199    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn" event={"ID":"12f537eb-7889-4cd8-a78d-96cb2bcab8d8","Type":"ContainerDied","Data":"dea5bb86d95f2139856a7b378ed6cb8c9629c8f43f6516c03f0d23ac07690cc8"}
Oct 30 22:43:30.606414 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:30.606277    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dea5bb86d95f2139856a7b378ed6cb8c9629c8f43f6516c03f0d23ac07690cc8"
Oct 30 22:43:32.340232 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:32.340189    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:43:39.599085 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:39.599049    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:43:43.160284 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:43:43.160236    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:43:48.617827 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.617790    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"]
Oct 30 22:43:48.618369 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.618276    5258 cpu_manager.go:414] "containerMap: removing container" podUID="12f537eb-7889-4cd8-a78d-96cb2bcab8d8" containerName="revoke-keys"
Oct 30 22:43:48.618369 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.618288    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="12f537eb-7889-4cd8-a78d-96cb2bcab8d8" containerName="revoke-keys"
Oct 30 22:43:48.618369 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.618361    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="12f537eb-7889-4cd8-a78d-96cb2bcab8d8" containerName="revoke-keys"
Oct 30 22:43:48.621444 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.621423    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.644480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.644447    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.644621 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.644487    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.644673 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.644623    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.644673 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.644660    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.644793 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.644771    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.644852 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.644800    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.644852 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.644829    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.644934 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.644908    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6f5v\" (UniqueName: \"kubernetes.io/projected/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-kube-api-access-j6f5v\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.644976 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.644938    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.726790 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.726756    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"]
Oct 30 22:43:48.746095 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.746062    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.746259 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.746115    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.746259 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.746161    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.746259 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.746200    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.746259 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.746238    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6f5v\" (UniqueName: \"kubernetes.io/projected/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-kube-api-access-j6f5v\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.746480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.746269    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.746480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.746323    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.746480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.746354    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.746674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.746479    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.746674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.746604    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istio-data\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.746827 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.746782    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-workload-certs\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.746966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.746845    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-workload-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.746966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.746915    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-credential-socket\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.747206 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.747181    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.748821 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.748798    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istio-envoy\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.748910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.748832    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istio-podinfo\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.808238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.808205    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-istio-token\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.808374 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.808272    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6f5v\" (UniqueName: \"kubernetes.io/projected/5c149d2a-e6e0-45fd-978d-a1d5c0137d79-kube-api-access-j6f5v\") pod \"maas-default-gateway-openshift-default-76597d6855-vfb7s\" (UID: \"5c149d2a-e6e0-45fd-978d-a1d5c0137d79\") " pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:48.934814 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:48.934727    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:49.370760 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:49.370733    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"]
Oct 30 22:43:49.373271 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:43:49.373241    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c149d2a_e6e0_45fd_978d_a1d5c0137d79.slice/crio-4515a7bd711197454eb89233f91b7b1c1e15fa9d236cd26bde9664ecba613ff2 WatchSource:0}: Error finding container 4515a7bd711197454eb89233f91b7b1c1e15fa9d236cd26bde9664ecba613ff2: Status 404 returned error can't find the container with id 4515a7bd711197454eb89233f91b7b1c1e15fa9d236cd26bde9664ecba613ff2
Oct 30 22:43:49.375468 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:49.375434    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:43:49.375550 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:49.375512    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:43:49.375628 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:49.375551    5258 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:43:49.743347 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:49.743262    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s" event={"ID":"5c149d2a-e6e0-45fd-978d-a1d5c0137d79","Type":"ContainerStarted","Data":"b9e05ca1bcfe51e30ee0099e3d333a5c56a3b8659e5ed196c1b1ca82c411ec98"}
Oct 30 22:43:49.743347 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:49.743325    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s" event={"ID":"5c149d2a-e6e0-45fd-978d-a1d5c0137d79","Type":"ContainerStarted","Data":"4515a7bd711197454eb89233f91b7b1c1e15fa9d236cd26bde9664ecba613ff2"}
Oct 30 22:43:49.892896 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:49.892843    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s" podStartSLOduration=1.892829619 podStartE2EDuration="1.892829619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:43:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:43:49.890627587 +0000 UTC m=+2944.621484732" watchObservedRunningTime="2026-10-30 22:43:49.892829619 +0000 UTC m=+2944.623686762"
Oct 30 22:43:49.934964 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:49.934931    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:50.825885 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:50.825852    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:43:50.936637 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:50.936582    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vfb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused" start-of-body=
Oct 30 22:43:50.936808 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:50.936651    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s" podUID="5c149d2a-e6e0-45fd-978d-a1d5c0137d79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused"
Oct 30 22:43:51.935670 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:51.935637    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vfb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused" start-of-body=
Oct 30 22:43:51.936091 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:51.935701    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s" podUID="5c149d2a-e6e0-45fd-978d-a1d5c0137d79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused"
Oct 30 22:43:52.935672 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:52.935636    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vfb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused" start-of-body=
Oct 30 22:43:52.935852 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:52.935688    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s" podUID="5c149d2a-e6e0-45fd-978d-a1d5c0137d79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused"
Oct 30 22:43:53.935053 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:53.935013    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vfb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused" start-of-body=
Oct 30 22:43:53.935257 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:53.935070    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s" podUID="5c149d2a-e6e0-45fd-978d-a1d5c0137d79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused"
Oct 30 22:43:54.935987 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:54.935946    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vfb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused" start-of-body=
Oct 30 22:43:54.936389 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:54.936014    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s" podUID="5c149d2a-e6e0-45fd-978d-a1d5c0137d79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused"
Oct 30 22:43:55.935435 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:55.935400    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vfb7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused" start-of-body=
Oct 30 22:43:55.935690 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:55.935464    5258 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s" podUID="5c149d2a-e6e0-45fd-978d-a1d5c0137d79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.149:15021/healthz/ready\": dial tcp 10.132.0.149:15021: connect: connection refused"
Oct 30 22:43:57.678569 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:57.678535    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:57.679755 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:57.679727    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:43:57.680790 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:43:57.680765    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s"
Oct 30 22:44:13.160840 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:44:13.160800    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:44:14.611867 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:44:14.611827    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:44:27.913510 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:44:27.913432    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:44:32.676437 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:44:32.676396    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:44:34.680117 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:44:34.680073    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:44:36.894677 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:44:36.894642    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:44:43.160365 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:44:43.160323    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:44:45.858549 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:44:45.858521    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:44:45.862284 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:44:45.862259    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:44:59.104161 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:44:59.104124    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:45:09.895333 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:45:09.895297    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:45:13.160567 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:45:13.160518    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:45:22.963350 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:45:22.963310    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:45:33.069948 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:45:33.069906    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:45:43.160897 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:45:43.160862    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:45:48.094020 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:45:48.093983    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:45:57.994174 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:45:57.994086    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:46:13.160392 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:46:13.160353    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:46:19.393483 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:46:19.393453    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:46:26.067046 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:46:26.067010    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"]
Oct 30 22:46:26.115943 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:46:26.115899    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-459c11f3-xxl28"]
Oct 30 22:46:27.386019 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:46:27.385979    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="996258de-38f8-4634-8f6e-e28508400135" path="/var/lib/kubelet/pods/996258de-38f8-4634-8f6e-e28508400135/volumes"
Oct 30 22:46:28.744719 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:46:28.744677    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vfb7s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.149:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:46:28.745348 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:46:28.745311    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s" podUID="5c149d2a-e6e0-45fd-978d-a1d5c0137d79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.149:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:46:32.390555 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:46:32.390522    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:46:33.390585 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:46:33.390546    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:41.711424 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:46:41.711388    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:43.160209 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:46:43.160173    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:46:47.807898 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:46:47.807860    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:52.002086 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:46:52.002049    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:47:13.160210 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:47:13.160169    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:47:14.292153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:47:14.292118    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:47:27.407441 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:47:27.407365    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:47:33.710946 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:47:33.710915    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:39.079795 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:47:39.079749    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:47:43.162578 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:47:43.162530    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:47:46.560776 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:47:46.560740    5258 scope.go:122] "RemoveContainer" containerID="d56c1512b629df0f6b89aa2d95cc4c119b99e6995922137c49fda3fb1b528ecd"
Oct 30 22:47:46.569801 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:47:46.569780    5258 scope.go:122] "RemoveContainer" containerID="ee2da63f60bce0e3f0b0ec5af79590da4a2f0fc1604094fad11449912fa3c3b6"
Oct 30 22:48:01.476032 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:48:01.475998    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:48:11.893238 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:48:11.893204    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:48:13.160322 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:48:13.160289    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:48:27.302469 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:48:27.302434    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:48:30.064612 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:48:30.063018    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"]
Oct 30 22:48:30.141634 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:48:30.141576    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-wvxcn"]
Oct 30 22:48:31.380281 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:48:31.380246    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="12f537eb-7889-4cd8-a78d-96cb2bcab8d8" path="/var/lib/kubelet/pods/12f537eb-7889-4cd8-a78d-96cb2bcab8d8/volumes"
Oct 30 22:48:34.074764 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:48:34.074728    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:43.160723 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:48:43.160673    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:48:47.409500 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:48:47.409463    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:48:50.427764 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:48:50.427728    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-shttj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:48:50.428242 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:48:50.427814    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj" podUID="9540d501-45f8-42fb-b3e3-da60a19f9301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:48:58.286264 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:48:58.286181    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:49:13.160956 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:49:13.160919    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:49:17.605674 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:17.605639    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:49:28.376577 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:28.376532    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:49:36.669732 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:36.669672    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:49:36.896884 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:36.896849    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:49:39.375070 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:39.375033    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:49:39.636680 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:39.636551    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:49:39.889866 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:39.889774    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:49:42.744943 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:42.744908    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:49:43.003912 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:43.003827    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:49:43.161750 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:49:43.161708    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:49:45.657620 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.657570    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"]
Oct 30 22:49:45.661548 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.661527    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:45.707892 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.707860    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-metrics-certs\") pod \"maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:45.708051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.707894    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzm8x\" (UniqueName: \"kubernetes.io/projected/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-kube-api-access-gzm8x\") pod \"maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:45.708051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.707914    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:45.708051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.708041    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:45.763666 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.763630    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-72648e-serving-cert\""
Oct 30 22:49:45.763831 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.763680    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:49:45.763831 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.763700    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:49:45.763831 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.763704    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zj8wn\""
Oct 30 22:49:45.763831 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.763824    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 22:49:45.766494 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.766475    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"]
Oct 30 22:49:45.809880 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.809839    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-metrics-certs\") pod \"maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:45.810062 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.809899    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzm8x\" (UniqueName: \"kubernetes.io/projected/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-kube-api-access-gzm8x\") pod \"maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:45.810062 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.809937    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:45.810062 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.810004    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:45.810245 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:49:45.810192    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-serving-cert: secret "maas-api-e2e-worker-single-main-72648e-serving-cert" not found
Oct 30 22:49:45.810305 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:49:45.810293    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-maas-api-tls podName:fff0cc52-6d4f-4bcf-a148-8f2a10816e68 nodeName:}" failed. No retries permitted until 2026-10-30 22:49:46.310270815 +0000 UTC m=+3301.041127943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-maas-api-tls") pod "maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4" (UID: "fff0cc52-6d4f-4bcf-a148-8f2a10816e68") : secret "maas-api-e2e-worker-single-main-72648e-serving-cert" not found
Oct 30 22:49:45.810760 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.810735    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:45.812854 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.812836    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-metrics-certs\") pod \"maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:45.871892 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.871859    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzm8x\" (UniqueName: \"kubernetes.io/projected/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-kube-api-access-gzm8x\") pod \"maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:45.904129 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.904089    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:49:45.921525 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.921430    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:49:45.926886 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:45.926797    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:49:46.196711 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:46.196611    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:49:46.316090 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:46.316003    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:46.318431 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:46.318396    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:46.575379 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:46.575347    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:46.604889 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:46.604851    5258 scope.go:122] "RemoveContainer" containerID="d36cb9ea6c23e6ccab5fd2c18f629a8ef7ed7b34dbb9d75c2d3c95096fffcf3f"
Oct 30 22:49:46.956168 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:46.956142    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"]
Oct 30 22:49:46.958479 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:49:46.958444    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff0cc52_6d4f_4bcf_a148_8f2a10816e68.slice/crio-1a519b49c844f308ee04a61235aab3c91a2b66a7d55130bf3db3a370929a2ea0 WatchSource:0}: Error finding container 1a519b49c844f308ee04a61235aab3c91a2b66a7d55130bf3db3a370929a2ea0: Status 404 returned error can't find the container with id 1a519b49c844f308ee04a61235aab3c91a2b66a7d55130bf3db3a370929a2ea0
Oct 30 22:49:46.959938 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:46.959909    5258 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:49:47.341001 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:47.340966    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4" event={"ID":"fff0cc52-6d4f-4bcf-a148-8f2a10816e68","Type":"ContainerStarted","Data":"1a519b49c844f308ee04a61235aab3c91a2b66a7d55130bf3db3a370929a2ea0"}
Oct 30 22:49:48.348727 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:48.348689    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4" event={"ID":"fff0cc52-6d4f-4bcf-a148-8f2a10816e68","Type":"ContainerStarted","Data":"b57953dde600df7adee11c53c95487f2deb4702044091c21793ac4486126f458"}
Oct 30 22:49:48.349109 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:48.348795    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:48.469881 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:48.469821    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4" podStartSLOduration=2.636017421 podStartE2EDuration="3.469806895s" totalImagesPullingTime="833.789474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:49:48.467702311 +0000 UTC m=+3303.198559451" watchObservedRunningTime="2026-10-30 22:49:48.469806895 +0000 UTC m=+3303.200664038"
Oct 30 22:49:51.080011 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:51.079974    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:49:54.006999 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:54.006959    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:49:54.361116 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:54.361089    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:49:56.055681 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:49:56.055643    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:01.038962 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:01.038922    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:04.376968 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:04.376932    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:05.022849 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:05.022812    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:05.256822 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:05.256782    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:06.186443 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:06.186406    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:08.061011 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:08.060972    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:11.175649 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:11.175605    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:12.709455 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:12.709417    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:50:13.162658 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:50:13.162581    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:50:16.282119 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:16.282077    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:21.142369 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:21.142334    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:26.185424 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:26.185331    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:31.172141 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:31.172107    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:34.783328 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:34.783287    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:36.167783 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:36.167745    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:41.067037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:41.066980    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:43.163914 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:50:43.163866    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:50:43.725745 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:43.725703    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:50:46.079880 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:46.079825    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:51.046888 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:51.046850    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:56.055571 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:50:56.055530    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:00.955713 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:00.955667    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:05.956216 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:05.956175    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:10.071091 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:10.071058    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:10.944046 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:10.944008    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:13.008125 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:13.008081    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:51:13.163700 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:51:13.163661    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:51:14.953745 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:14.953711    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:16.249777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:16.249741    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:21.182790 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:21.182751    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:22.276049 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:22.276014    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:22.594743 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:22.594697    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:25.383142 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:25.383113    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"]
Oct 30 22:51:25.383620 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:25.383286    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4" podUID="fff0cc52-6d4f-4bcf-a148-8f2a10816e68" containerName="maas-api" containerID="cri-o://b57953dde600df7adee11c53c95487f2deb4702044091c21793ac4486126f458" gracePeriod=30
Oct 30 22:51:25.544548 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:25.544510    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:26.635061 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.635036    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:51:26.756256 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.755830    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-kube-api-access-gzm8x\" (UniqueName: \"kubernetes.io/projected/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-kube-api-access-gzm8x\") pod \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") "
Oct 30 22:51:26.756585 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.756520    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-openshift-service-ca\") pod \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") "
Oct 30 22:51:26.757296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.756763    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-metrics-certs\" (UniqueName: \"kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-metrics-certs\") pod \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") "
Oct 30 22:51:26.757296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.756801    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-maas-api-tls\") pod \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\" (UID: \"fff0cc52-6d4f-4bcf-a148-8f2a10816e68\") "
Oct 30 22:51:26.757296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.757041    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-openshift-service-ca" pod "fff0cc52-6d4f-4bcf-a148-8f2a10816e68" (UID: "fff0cc52-6d4f-4bcf-a148-8f2a10816e68"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:51:26.757296 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.757202    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:51:26.759859 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.759813    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-metrics-certs" pod "fff0cc52-6d4f-4bcf-a148-8f2a10816e68" (UID: "fff0cc52-6d4f-4bcf-a148-8f2a10816e68"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:51:26.759966 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.759938    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-maas-api-tls" pod "fff0cc52-6d4f-4bcf-a148-8f2a10816e68" (UID: "fff0cc52-6d4f-4bcf-a148-8f2a10816e68"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:51:26.767043 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.767019    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-kube-api-access-gzm8x" pod "fff0cc52-6d4f-4bcf-a148-8f2a10816e68" (UID: "fff0cc52-6d4f-4bcf-a148-8f2a10816e68"). InnerVolumeSpecName "kube-api-access-gzm8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:51:26.858701 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.858664    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:51:26.858701 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.858695    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:51:26.858893 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.858710    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzm8x\" (UniqueName: \"kubernetes.io/projected/fff0cc52-6d4f-4bcf-a148-8f2a10816e68-kube-api-access-gzm8x\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:51:26.922463 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.922427    5258 generic.go:356] "Generic (PLEG): container finished" podID="fff0cc52-6d4f-4bcf-a148-8f2a10816e68" containerID="b57953dde600df7adee11c53c95487f2deb4702044091c21793ac4486126f458" exitCode=0
Oct 30 22:51:26.922647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.922473    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"
Oct 30 22:51:26.922647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.922487    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4" event={"ID":"fff0cc52-6d4f-4bcf-a148-8f2a10816e68","Type":"ContainerDied","Data":"b57953dde600df7adee11c53c95487f2deb4702044091c21793ac4486126f458"}
Oct 30 22:51:26.922647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.922538    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4" event={"ID":"fff0cc52-6d4f-4bcf-a148-8f2a10816e68","Type":"ContainerDied","Data":"1a519b49c844f308ee04a61235aab3c91a2b66a7d55130bf3db3a370929a2ea0"}
Oct 30 22:51:26.922647 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.922568    5258 scope.go:122] "RemoveContainer" containerID="b57953dde600df7adee11c53c95487f2deb4702044091c21793ac4486126f458"
Oct 30 22:51:26.934801 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.934779    5258 scope.go:122] "RemoveContainer" containerID="b57953dde600df7adee11c53c95487f2deb4702044091c21793ac4486126f458"
Oct 30 22:51:26.935089 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:51:26.935059    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b57953dde600df7adee11c53c95487f2deb4702044091c21793ac4486126f458\": container with ID starting with b57953dde600df7adee11c53c95487f2deb4702044091c21793ac4486126f458 not found: ID does not exist" containerID="b57953dde600df7adee11c53c95487f2deb4702044091c21793ac4486126f458"
Oct 30 22:51:26.935141 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:26.935105    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b57953dde600df7adee11c53c95487f2deb4702044091c21793ac4486126f458"} err="failed to get container status \"b57953dde600df7adee11c53c95487f2deb4702044091c21793ac4486126f458\": rpc error: code = NotFound desc = could not find container \"b57953dde600df7adee11c53c95487f2deb4702044091c21793ac4486126f458\": container with ID starting with b57953dde600df7adee11c53c95487f2deb4702044091c21793ac4486126f458 not found: ID does not exist"
Oct 30 22:51:26.953084 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:51:26.953057    5258 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff0cc52_6d4f_4bcf_a148_8f2a10816e68.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff0cc52_6d4f_4bcf_a148_8f2a10816e68.slice/crio-1a519b49c844f308ee04a61235aab3c91a2b66a7d55130bf3db3a370929a2ea0\": RecentStats: unable to find data in memory cache]"
Oct 30 22:51:27.089460 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:27.089427    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"]
Oct 30 22:51:27.097080 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:27.097050    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-72648e-6869459474-zhbd4"]
Oct 30 22:51:27.121785 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:27.121752    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:27.384826 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:27.384748    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fff0cc52-6d4f-4bcf-a148-8f2a10816e68" path="/var/lib/kubelet/pods/fff0cc52-6d4f-4bcf-a148-8f2a10816e68/volumes"
Oct 30 22:51:27.399798 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:27.399769    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:28.195263 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:28.195232    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:30.304002 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:30.303968    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:51:35.081534 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:35.081494    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:35.391001 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:35.390910    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:35.681836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:35.681742    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:37.343884 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.343846    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"]
Oct 30 22:51:37.344316 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.344302    5258 cpu_manager.go:414] "containerMap: removing container" podUID="fff0cc52-6d4f-4bcf-a148-8f2a10816e68" containerName="maas-api"
Oct 30 22:51:37.344361 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.344318    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fff0cc52-6d4f-4bcf-a148-8f2a10816e68" containerName="maas-api"
Oct 30 22:51:37.344422 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.344413    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="fff0cc52-6d4f-4bcf-a148-8f2a10816e68" containerName="maas-api"
Oct 30 22:51:37.348938 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.348921    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"
Oct 30 22:51:37.406736 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.406707    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"]
Oct 30 22:51:37.452998 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.452963    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:51:37.452998 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.452999    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:51:37.453252 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.453002    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:51:37.453252 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.453036    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l4mjj\""
Oct 30 22:51:37.458275 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.458251    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/73c4f1d8-408f-4b30-837c-86a0e175629a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-bhzln\" (UID: \"73c4f1d8-408f-4b30-837c-86a0e175629a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"
Oct 30 22:51:37.458402 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.458306    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppczd\" (UniqueName: \"kubernetes.io/projected/73c4f1d8-408f-4b30-837c-86a0e175629a-kube-api-access-ppczd\") pod \"maas-api-revoke-sub-3d4156f1-bhzln\" (UID: \"73c4f1d8-408f-4b30-837c-86a0e175629a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"
Oct 30 22:51:37.458457 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.458433    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/73c4f1d8-408f-4b30-837c-86a0e175629a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-bhzln\" (UID: \"73c4f1d8-408f-4b30-837c-86a0e175629a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"
Oct 30 22:51:37.559254 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.559225    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/73c4f1d8-408f-4b30-837c-86a0e175629a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-bhzln\" (UID: \"73c4f1d8-408f-4b30-837c-86a0e175629a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"
Oct 30 22:51:37.559453 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.559318    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/73c4f1d8-408f-4b30-837c-86a0e175629a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-bhzln\" (UID: \"73c4f1d8-408f-4b30-837c-86a0e175629a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"
Oct 30 22:51:37.559453 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.559358    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppczd\" (UniqueName: \"kubernetes.io/projected/73c4f1d8-408f-4b30-837c-86a0e175629a-kube-api-access-ppczd\") pod \"maas-api-revoke-sub-3d4156f1-bhzln\" (UID: \"73c4f1d8-408f-4b30-837c-86a0e175629a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"
Oct 30 22:51:37.560093 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.560066    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/73c4f1d8-408f-4b30-837c-86a0e175629a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3d4156f1-bhzln\" (UID: \"73c4f1d8-408f-4b30-837c-86a0e175629a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"
Oct 30 22:51:37.561551 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.561527    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/73c4f1d8-408f-4b30-837c-86a0e175629a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3d4156f1-bhzln\" (UID: \"73c4f1d8-408f-4b30-837c-86a0e175629a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"
Oct 30 22:51:37.621528 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.621468    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppczd\" (UniqueName: \"kubernetes.io/projected/73c4f1d8-408f-4b30-837c-86a0e175629a-kube-api-access-ppczd\") pod \"maas-api-revoke-sub-3d4156f1-bhzln\" (UID: \"73c4f1d8-408f-4b30-837c-86a0e175629a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"
Oct 30 22:51:37.662914 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:37.662890    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"
Oct 30 22:51:38.046938 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:38.046908    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"]
Oct 30 22:51:38.048866 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:51:38.048844    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c4f1d8_408f_4b30_837c_86a0e175629a.slice/crio-75e1844017d0b641f635f2392ab98ff9bcdb2d9d3c8cf6818bcbbe0fa8169b4e WatchSource:0}: Error finding container 75e1844017d0b641f635f2392ab98ff9bcdb2d9d3c8cf6818bcbbe0fa8169b4e: Status 404 returned error can't find the container with id 75e1844017d0b641f635f2392ab98ff9bcdb2d9d3c8cf6818bcbbe0fa8169b4e
Oct 30 22:51:38.992781 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:38.992746    5258 generic.go:356] "Generic (PLEG): container finished" podID="73c4f1d8-408f-4b30-837c-86a0e175629a" containerID="0bd65493429d52fc168b95c8c0b8abf113754a777a6947481acef645c513d391" exitCode=0
Oct 30 22:51:38.993133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:38.992811    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln" event={"ID":"73c4f1d8-408f-4b30-837c-86a0e175629a","Type":"ContainerDied","Data":"0bd65493429d52fc168b95c8c0b8abf113754a777a6947481acef645c513d391"}
Oct 30 22:51:38.993133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:38.992851    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln" event={"ID":"73c4f1d8-408f-4b30-837c-86a0e175629a","Type":"ContainerStarted","Data":"75e1844017d0b641f635f2392ab98ff9bcdb2d9d3c8cf6818bcbbe0fa8169b4e"}
Oct 30 22:51:40.149163 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:40.149139    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"
Oct 30 22:51:40.183921 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:40.183892    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/73c4f1d8-408f-4b30-837c-86a0e175629a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/73c4f1d8-408f-4b30-837c-86a0e175629a-maas-api-xks-ca\") pod \"73c4f1d8-408f-4b30-837c-86a0e175629a\" (UID: \"73c4f1d8-408f-4b30-837c-86a0e175629a\") "
Oct 30 22:51:40.184069 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:40.183965    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/73c4f1d8-408f-4b30-837c-86a0e175629a-kube-api-access-ppczd\" (UniqueName: \"kubernetes.io/projected/73c4f1d8-408f-4b30-837c-86a0e175629a-kube-api-access-ppczd\") pod \"73c4f1d8-408f-4b30-837c-86a0e175629a\" (UID: \"73c4f1d8-408f-4b30-837c-86a0e175629a\") "
Oct 30 22:51:40.184146 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:40.184074    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/73c4f1d8-408f-4b30-837c-86a0e175629a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/73c4f1d8-408f-4b30-837c-86a0e175629a-maas-api-openshift-ca\") pod \"73c4f1d8-408f-4b30-837c-86a0e175629a\" (UID: \"73c4f1d8-408f-4b30-837c-86a0e175629a\") "
Oct 30 22:51:40.184414 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:40.184386    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73c4f1d8-408f-4b30-837c-86a0e175629a-maas-api-openshift-ca" pod "73c4f1d8-408f-4b30-837c-86a0e175629a" (UID: "73c4f1d8-408f-4b30-837c-86a0e175629a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:51:40.185980 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:40.185952    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73c4f1d8-408f-4b30-837c-86a0e175629a-maas-api-xks-ca" pod "73c4f1d8-408f-4b30-837c-86a0e175629a" (UID: "73c4f1d8-408f-4b30-837c-86a0e175629a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:51:40.186113 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:40.186094    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73c4f1d8-408f-4b30-837c-86a0e175629a-kube-api-access-ppczd" pod "73c4f1d8-408f-4b30-837c-86a0e175629a" (UID: "73c4f1d8-408f-4b30-837c-86a0e175629a"). InnerVolumeSpecName "kube-api-access-ppczd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:51:40.285495 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:40.285422    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppczd\" (UniqueName: \"kubernetes.io/projected/73c4f1d8-408f-4b30-837c-86a0e175629a-kube-api-access-ppczd\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:51:40.285495 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:40.285449    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/73c4f1d8-408f-4b30-837c-86a0e175629a-maas-api-openshift-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:51:40.285495 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:40.285462    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/73c4f1d8-408f-4b30-837c-86a0e175629a-maas-api-xks-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:51:41.008033 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:41.008001    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"
Oct 30 22:51:41.008199 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:41.008032    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln" event={"ID":"73c4f1d8-408f-4b30-837c-86a0e175629a","Type":"ContainerDied","Data":"75e1844017d0b641f635f2392ab98ff9bcdb2d9d3c8cf6818bcbbe0fa8169b4e"}
Oct 30 22:51:41.008199 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:41.008094    5258 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75e1844017d0b641f635f2392ab98ff9bcdb2d9d3c8cf6818bcbbe0fa8169b4e"
Oct 30 22:51:42.951439 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:42.951399    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:43.160959 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:51:43.160919    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:51:51.806410 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:51.806369    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:53.643774 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:53.643727    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:59.460636 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:59.460538    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"]
Oct 30 22:51:59.461056 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:59.460773    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q" podUID="ffbba870-a25b-4779-80c2-e907a8912908" containerName="manager" containerID="cri-o://7c83659890137182836c8b9be2949c43c01a6df4468a8b7d321be43b8348a7e3" gracePeriod=10
Oct 30 22:51:59.735018 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:59.734994    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"
Oct 30 22:51:59.879384 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:59.879357    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ffbba870-a25b-4779-80c2-e907a8912908-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffbba870-a25b-4779-80c2-e907a8912908-extensions-socket-volume\") pod \"ffbba870-a25b-4779-80c2-e907a8912908\" (UID: \"ffbba870-a25b-4779-80c2-e907a8912908\") "
Oct 30 22:51:59.879544 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:59.879435    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ffbba870-a25b-4779-80c2-e907a8912908-kube-api-access-prxb4\" (UniqueName: \"kubernetes.io/projected/ffbba870-a25b-4779-80c2-e907a8912908-kube-api-access-prxb4\") pod \"ffbba870-a25b-4779-80c2-e907a8912908\" (UID: \"ffbba870-a25b-4779-80c2-e907a8912908\") "
Oct 30 22:51:59.879755 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:59.879733    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffbba870-a25b-4779-80c2-e907a8912908-extensions-socket-volume" pod "ffbba870-a25b-4779-80c2-e907a8912908" (UID: "ffbba870-a25b-4779-80c2-e907a8912908"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:51:59.881724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:59.881697    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffbba870-a25b-4779-80c2-e907a8912908-kube-api-access-prxb4" pod "ffbba870-a25b-4779-80c2-e907a8912908" (UID: "ffbba870-a25b-4779-80c2-e907a8912908"). InnerVolumeSpecName "kube-api-access-prxb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:51:59.981143 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:59.981064    5258 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffbba870-a25b-4779-80c2-e907a8912908-extensions-socket-volume\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:51:59.981143 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:51:59.981095    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prxb4\" (UniqueName: \"kubernetes.io/projected/ffbba870-a25b-4779-80c2-e907a8912908-kube-api-access-prxb4\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:52:00.110881 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:52:00.110842    5258 generic.go:356] "Generic (PLEG): container finished" podID="ffbba870-a25b-4779-80c2-e907a8912908" containerID="7c83659890137182836c8b9be2949c43c01a6df4468a8b7d321be43b8348a7e3" exitCode=0
Oct 30 22:52:00.111066 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:52:00.110892    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"
Oct 30 22:52:00.111066 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:52:00.110933    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q" event={"ID":"ffbba870-a25b-4779-80c2-e907a8912908","Type":"ContainerDied","Data":"7c83659890137182836c8b9be2949c43c01a6df4468a8b7d321be43b8348a7e3"}
Oct 30 22:52:00.111066 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:52:00.110982    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q" event={"ID":"ffbba870-a25b-4779-80c2-e907a8912908","Type":"ContainerDied","Data":"1cea0f7b6444f68d07f671bda25566cafa8b24ae995c89996defb325380ae586"}
Oct 30 22:52:00.111066 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:52:00.111004    5258 scope.go:122] "RemoveContainer" containerID="7c83659890137182836c8b9be2949c43c01a6df4468a8b7d321be43b8348a7e3"
Oct 30 22:52:00.124865 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:52:00.124840    5258 scope.go:122] "RemoveContainer" containerID="7c83659890137182836c8b9be2949c43c01a6df4468a8b7d321be43b8348a7e3"
Oct 30 22:52:00.125171 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:52:00.125140    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c83659890137182836c8b9be2949c43c01a6df4468a8b7d321be43b8348a7e3\": container with ID starting with 7c83659890137182836c8b9be2949c43c01a6df4468a8b7d321be43b8348a7e3 not found: ID does not exist" containerID="7c83659890137182836c8b9be2949c43c01a6df4468a8b7d321be43b8348a7e3"
Oct 30 22:52:00.125286 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:52:00.125175    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c83659890137182836c8b9be2949c43c01a6df4468a8b7d321be43b8348a7e3"} err="failed to get container status \"7c83659890137182836c8b9be2949c43c01a6df4468a8b7d321be43b8348a7e3\": rpc error: code = NotFound desc = could not find container \"7c83659890137182836c8b9be2949c43c01a6df4468a8b7d321be43b8348a7e3\": container with ID starting with 7c83659890137182836c8b9be2949c43c01a6df4468a8b7d321be43b8348a7e3 not found: ID does not exist"
Oct 30 22:52:00.282354 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:52:00.282287    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"]
Oct 30 22:52:00.289316 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:52:00.289294    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-89n5q"]
Oct 30 22:52:00.820672 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:52:00.820630    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:01.380107 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:52:01.380076    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ffbba870-a25b-4779-80c2-e907a8912908" path="/var/lib/kubelet/pods/ffbba870-a25b-4779-80c2-e907a8912908/volumes"
Oct 30 22:52:13.160863 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:52:13.160826    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:52:35.434419 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:52:35.434383    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:43.160750 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:52:43.160705    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:53:03.133573 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.133538    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9"]
Oct 30 22:53:03.134113 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.134084    5258 cpu_manager.go:414] "containerMap: removing container" podUID="ffbba870-a25b-4779-80c2-e907a8912908" containerName="manager"
Oct 30 22:53:03.134113 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.134100    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ffbba870-a25b-4779-80c2-e907a8912908" containerName="manager"
Oct 30 22:53:03.134191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.134116    5258 cpu_manager.go:414] "containerMap: removing container" podUID="73c4f1d8-408f-4b30-837c-86a0e175629a" containerName="revoke-keys"
Oct 30 22:53:03.134191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.134122    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="73c4f1d8-408f-4b30-837c-86a0e175629a" containerName="revoke-keys"
Oct 30 22:53:03.134260 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.134200    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="ffbba870-a25b-4779-80c2-e907a8912908" containerName="manager"
Oct 30 22:53:03.134260 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.134208    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="73c4f1d8-408f-4b30-837c-86a0e175629a" containerName="revoke-keys"
Oct 30 22:53:03.137489 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.137469    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9"
Oct 30 22:53:03.174024 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.173995    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc7af4e1-189e-4dd1-9bc7-c4790560a76c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-tr8h9\" (UID: \"dc7af4e1-189e-4dd1-9bc7-c4790560a76c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9"
Oct 30 22:53:03.174161 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.174038    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfpjd\" (UniqueName: \"kubernetes.io/projected/dc7af4e1-189e-4dd1-9bc7-c4790560a76c-kube-api-access-zfpjd\") pod \"kuadrant-operator-controller-manager-678d87766f-tr8h9\" (UID: \"dc7af4e1-189e-4dd1-9bc7-c4790560a76c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9"
Oct 30 22:53:03.190290 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.190262    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9"]
Oct 30 22:53:03.236072 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.236049    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8t5r7\""
Oct 30 22:53:03.275395 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.275362    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc7af4e1-189e-4dd1-9bc7-c4790560a76c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-tr8h9\" (UID: \"dc7af4e1-189e-4dd1-9bc7-c4790560a76c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9"
Oct 30 22:53:03.275525 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.275410    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfpjd\" (UniqueName: \"kubernetes.io/projected/dc7af4e1-189e-4dd1-9bc7-c4790560a76c-kube-api-access-zfpjd\") pod \"kuadrant-operator-controller-manager-678d87766f-tr8h9\" (UID: \"dc7af4e1-189e-4dd1-9bc7-c4790560a76c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9"
Oct 30 22:53:03.275765 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.275746    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc7af4e1-189e-4dd1-9bc7-c4790560a76c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-tr8h9\" (UID: \"dc7af4e1-189e-4dd1-9bc7-c4790560a76c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9"
Oct 30 22:53:03.338316 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.338291    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfpjd\" (UniqueName: \"kubernetes.io/projected/dc7af4e1-189e-4dd1-9bc7-c4790560a76c-kube-api-access-zfpjd\") pod \"kuadrant-operator-controller-manager-678d87766f-tr8h9\" (UID: \"dc7af4e1-189e-4dd1-9bc7-c4790560a76c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9"
Oct 30 22:53:03.450834 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.450769    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9"
Oct 30 22:53:03.934438 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:03.934410    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9"]
Oct 30 22:53:03.936356 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:53:03.936324    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7af4e1_189e_4dd1_9bc7_c4790560a76c.slice/crio-82380eb77b1912571254531f7cae26c0829a3f47c7728f3ada735a6de48eeedc WatchSource:0}: Error finding container 82380eb77b1912571254531f7cae26c0829a3f47c7728f3ada735a6de48eeedc: Status 404 returned error can't find the container with id 82380eb77b1912571254531f7cae26c0829a3f47c7728f3ada735a6de48eeedc
Oct 30 22:53:04.476652 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:04.476601    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9" event={"ID":"dc7af4e1-189e-4dd1-9bc7-c4790560a76c","Type":"ContainerStarted","Data":"215424a43cbde0737bb5482d51d72ec38677013ae7d35301fd84e16a51f43ee5"}
Oct 30 22:53:04.477050 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:04.476671    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9"
Oct 30 22:53:04.477050 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:04.476693    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9" event={"ID":"dc7af4e1-189e-4dd1-9bc7-c4790560a76c","Type":"ContainerStarted","Data":"82380eb77b1912571254531f7cae26c0829a3f47c7728f3ada735a6de48eeedc"}
Oct 30 22:53:04.600148 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:04.600095    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9" podStartSLOduration=1.60008119 podStartE2EDuration="1.60008119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:53:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:53:04.59858462 +0000 UTC m=+3499.329441762" watchObservedRunningTime="2026-10-30 22:53:04.60008119 +0000 UTC m=+3499.330938333"
Oct 30 22:53:13.159897 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:53:13.159853    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:53:15.484663 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:15.484621    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-tr8h9"
Oct 30 22:53:25.381924 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:25.381891    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:53:27.919763 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:27.919703    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-62dtc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:53:27.920421 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:27.920387    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc" podUID="8c139cbd-4b47-41c0-b11f-742a3ff3f81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:53:35.782192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:35.782154    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:42.990115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:42.990072    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:53:43.162188 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:53:43.162149    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:53:50.430178 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:50.429683    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-shttj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.111:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:53:50.430178 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:50.429761    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-shttj" podUID="9540d501-45f8-42fb-b3e3-da60a19f9301" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.111:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:53:52.879883 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:53:52.879845    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:54:11.865184 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:11.865145    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:12.306500 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:12.306466    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:54:12.613660 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:12.613557    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:13.161490 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:54:13.161448    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:54:14.014194 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:14.014160    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:17.073465 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:17.073422    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:17.344908 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:17.344819    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:20.232884 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:20.232844    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:20.461615 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:20.461563    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:22.745878 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.745843    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"]
Oct 30 22:54:22.749691 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.749667    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:22.802965 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.802935    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-c38ecf-serving-cert\""
Oct 30 22:54:22.837809 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.837764    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-metrics-certs\") pod \"maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:22.837971 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.837870    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:22.838056 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.838029    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvn4h\" (UniqueName: \"kubernetes.io/projected/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-kube-api-access-kvn4h\") pod \"maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:22.838125 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.838059    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:22.851465 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.851438    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 22:54:22.851637 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.851523    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:54:22.851637 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.851604    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zj8wn\""
Oct 30 22:54:22.851777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.851756    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:54:22.854277 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.854256    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"]
Oct 30 22:54:22.939305 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.939275    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvn4h\" (UniqueName: \"kubernetes.io/projected/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-kube-api-access-kvn4h\") pod \"maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:22.939480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.939317    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:22.939480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.939358    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-metrics-certs\") pod \"maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:22.939480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.939385    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:22.939687 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:54:22.939544    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-serving-cert: secret "maas-api-e2e-worker-single-main-c38ecf-serving-cert" not found
Oct 30 22:54:22.939687 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:54:22.939615    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-maas-api-tls podName:b52eb7ec-a72c-4079-ba2e-9b5b40278c4e nodeName:}" failed. No retries permitted until 2026-10-30 22:54:23.439583204 +0000 UTC m=+3578.170440325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-maas-api-tls") pod "maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt" (UID: "b52eb7ec-a72c-4079-ba2e-9b5b40278c4e") : secret "maas-api-e2e-worker-single-main-c38ecf-serving-cert" not found
Oct 30 22:54:22.940133 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.940106    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:22.941902 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:22.941878    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-metrics-certs\") pod \"maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:23.002379 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:23.002302    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvn4h\" (UniqueName: \"kubernetes.io/projected/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-kube-api-access-kvn4h\") pod \"maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:23.005444 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:23.005409    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:23.233475 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:23.233439    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:23.444150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:23.444120    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:23.446417 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:23.446389    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:23.662393 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:23.662367    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:24.041241 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:24.041216    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"]
Oct 30 22:54:24.043460 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:54:24.043434    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb52eb7ec_a72c_4079_ba2e_9b5b40278c4e.slice/crio-25d2ab90c1668eca7cc1155eb7e06718cb71b251f84ea322fcdce28419997f50 WatchSource:0}: Error finding container 25d2ab90c1668eca7cc1155eb7e06718cb71b251f84ea322fcdce28419997f50: Status 404 returned error can't find the container with id 25d2ab90c1668eca7cc1155eb7e06718cb71b251f84ea322fcdce28419997f50
Oct 30 22:54:25.016852 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:25.016819    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt" event={"ID":"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e","Type":"ContainerStarted","Data":"752b10bcb22439a36f858957923688441aaafd98e20ff06afb581ad488715568"}
Oct 30 22:54:25.017068 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:25.016868    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt" event={"ID":"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e","Type":"ContainerStarted","Data":"25d2ab90c1668eca7cc1155eb7e06718cb71b251f84ea322fcdce28419997f50"}
Oct 30 22:54:25.017068 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:25.017007    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:25.145574 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:25.145525    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt" podStartSLOduration=2.385153916 podStartE2EDuration="3.145510175s" totalImagesPullingTime="760.356259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:54:25.143687653 +0000 UTC m=+3579.874544798" watchObservedRunningTime="2026-10-30 22:54:25.145510175 +0000 UTC m=+3579.876367318"
Oct 30 22:54:28.163009 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:28.162971    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:31.028073 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:31.028042    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:54:31.184996 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:31.184963    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:54:33.181538 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:33.181504    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:36.112777 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:36.112734    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:38.260124 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:38.260083    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:41.813246 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:41.813211    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:43.165380 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:54:43.165347    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:54:44.082011 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:44.081974    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:45.144160 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:45.144127    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:45.960506 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:45.960474    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:54:45.968251 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:45.968227    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:54:48.657645 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:48.657571    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:49.886127 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:49.886090    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:54:53.660900 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:53.660860    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:58.640857 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:54:58.640764    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:03.639566 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:03.639523    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:06.217838 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:06.217799    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:08.561454 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:08.561410    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:13.161022 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:55:13.160989    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:55:13.572150 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:13.572116    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:18.008314 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:18.008252    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:55:18.588844 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:18.588812    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:23.585237 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:23.585199    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:28.544241 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:28.544207    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:33.521822 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:33.521773    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:36.519904 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:36.519867    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:38.469103 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:38.469060    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:42.338704 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:42.338641    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:43.160612 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:55:43.160558    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:55:43.660623 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:43.655841    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:44.205911 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:44.205873    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:55:47.403501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:47.403471    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:48.500782 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:48.500734    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:48.796304 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:48.796215    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:49.018435 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:49.018392    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:53.988618 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:53.988559    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:54.708881 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:54.708836    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:54.979918 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:54.979833    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:58.664297 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:55:58.664246    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:02.886458 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:02.886422    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"]
Oct 30 22:56:02.886939 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:02.886675    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt" podUID="b52eb7ec-a72c-4079-ba2e-9b5b40278c4e" containerName="maas-api" containerID="cri-o://752b10bcb22439a36f858957923688441aaafd98e20ff06afb581ad488715568" gracePeriod=30
Oct 30 22:56:03.141503 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:03.141423    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:04.144146 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.144116    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:56:04.244864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.244781    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-metrics-certs\") pod \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") "
Oct 30 22:56:04.244864 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.244846    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-kube-api-access-kvn4h\" (UniqueName: \"kubernetes.io/projected/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-kube-api-access-kvn4h\") pod \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") "
Oct 30 22:56:04.245144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.244916    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-openshift-service-ca\") pod \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") "
Oct 30 22:56:04.245144 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.244983    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-maas-api-tls\") pod \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\" (UID: \"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e\") "
Oct 30 22:56:04.245259 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.245244    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-openshift-service-ca" pod "b52eb7ec-a72c-4079-ba2e-9b5b40278c4e" (UID: "b52eb7ec-a72c-4079-ba2e-9b5b40278c4e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:56:04.245415 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.245392    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:56:04.247022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.246999    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-metrics-certs" pod "b52eb7ec-a72c-4079-ba2e-9b5b40278c4e" (UID: "b52eb7ec-a72c-4079-ba2e-9b5b40278c4e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:56:04.247108 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.247084    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-kube-api-access-kvn4h" pod "b52eb7ec-a72c-4079-ba2e-9b5b40278c4e" (UID: "b52eb7ec-a72c-4079-ba2e-9b5b40278c4e"). InnerVolumeSpecName "kube-api-access-kvn4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:56:04.247153 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.247112    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-maas-api-tls" pod "b52eb7ec-a72c-4079-ba2e-9b5b40278c4e" (UID: "b52eb7ec-a72c-4079-ba2e-9b5b40278c4e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:56:04.346195 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.346163    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:56:04.346195 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.346190    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:56:04.346371 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.346201    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvn4h\" (UniqueName: \"kubernetes.io/projected/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e-kube-api-access-kvn4h\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:56:04.582192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.582158    5258 generic.go:356] "Generic (PLEG): container finished" podID="b52eb7ec-a72c-4079-ba2e-9b5b40278c4e" containerID="752b10bcb22439a36f858957923688441aaafd98e20ff06afb581ad488715568" exitCode=0
Oct 30 22:56:04.582377 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.582204    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"
Oct 30 22:56:04.582377 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.582246    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt" event={"ID":"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e","Type":"ContainerDied","Data":"752b10bcb22439a36f858957923688441aaafd98e20ff06afb581ad488715568"}
Oct 30 22:56:04.582377 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.582304    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt" event={"ID":"b52eb7ec-a72c-4079-ba2e-9b5b40278c4e","Type":"ContainerDied","Data":"25d2ab90c1668eca7cc1155eb7e06718cb71b251f84ea322fcdce28419997f50"}
Oct 30 22:56:04.582377 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.582333    5258 scope.go:122] "RemoveContainer" containerID="752b10bcb22439a36f858957923688441aaafd98e20ff06afb581ad488715568"
Oct 30 22:56:04.593437 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.593419    5258 scope.go:122] "RemoveContainer" containerID="752b10bcb22439a36f858957923688441aaafd98e20ff06afb581ad488715568"
Oct 30 22:56:04.593771 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:56:04.593750    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"752b10bcb22439a36f858957923688441aaafd98e20ff06afb581ad488715568\": container with ID starting with 752b10bcb22439a36f858957923688441aaafd98e20ff06afb581ad488715568 not found: ID does not exist" containerID="752b10bcb22439a36f858957923688441aaafd98e20ff06afb581ad488715568"
Oct 30 22:56:04.593856 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.593780    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752b10bcb22439a36f858957923688441aaafd98e20ff06afb581ad488715568"} err="failed to get container status \"752b10bcb22439a36f858957923688441aaafd98e20ff06afb581ad488715568\": rpc error: code = NotFound desc = could not find container \"752b10bcb22439a36f858957923688441aaafd98e20ff06afb581ad488715568\": container with ID starting with 752b10bcb22439a36f858957923688441aaafd98e20ff06afb581ad488715568 not found: ID does not exist"
Oct 30 22:56:04.638697 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.638651    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:04.748502 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.748468    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"]
Oct 30 22:56:04.797895 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.797865    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-c38ecf-6ffbb9bc8b-xvdmt"]
Oct 30 22:56:04.922492 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:04.922376    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:05.379813 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:05.379780    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b52eb7ec-a72c-4079-ba2e-9b5b40278c4e" path="/var/lib/kubelet/pods/b52eb7ec-a72c-4079-ba2e-9b5b40278c4e/volumes"
Oct 30 22:56:05.707042 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:05.706958    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:07.862811 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:07.862772    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:56:12.772322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:12.772284    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:13.027022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:13.026938    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:13.161320 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:56:13.161283    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:56:13.277267 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:13.277171    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:20.202915 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:20.202870    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:22.646252 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:22.646223    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:23.666065 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:23.666029    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:25.471946 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:25.471912    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:56:26.376131 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:26.376086    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:27.918630 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:27.917682    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-62dtc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:56:27.918630 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:27.917790    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc" podUID="8c139cbd-4b47-41c0-b11f-742a3ff3f81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:56:28.727614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:28.726743    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-vfb7s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.149:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:56:28.727614 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:28.726811    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-vfb7s" podUID="5c149d2a-e6e0-45fd-978d-a1d5c0137d79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.149:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:56:36.841347 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:36.841295    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:41.059169 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:41.059132    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"]
Oct 30 22:56:41.108362 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:41.108332    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3d4156f1-bhzln"]
Oct 30 22:56:41.380804 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:41.380724    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="73c4f1d8-408f-4b30-837c-86a0e175629a" path="/var/lib/kubelet/pods/73c4f1d8-408f-4b30-837c-86a0e175629a/volumes"
Oct 30 22:56:43.161052 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:56:43.161014    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:56:43.241351 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:56:43.241319    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:02.883480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:02.883437    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"]
Oct 30 22:57:02.883977 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:02.883899    5258 cpu_manager.go:414] "containerMap: removing container" podUID="b52eb7ec-a72c-4079-ba2e-9b5b40278c4e" containerName="maas-api"
Oct 30 22:57:02.883977 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:02.883911    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b52eb7ec-a72c-4079-ba2e-9b5b40278c4e" containerName="maas-api"
Oct 30 22:57:02.884060 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:02.884014    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="b52eb7ec-a72c-4079-ba2e-9b5b40278c4e" containerName="maas-api"
Oct 30 22:57:02.887252 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:02.887234    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:02.989571 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:02.989538    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-4ab1c912-kserve-self-signed-certs\""
Oct 30 22:57:02.993521 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:02.993496    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"]
Oct 30 22:57:03.021945 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.021918    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d7e0114-2894-4398-92ab-347fbe0eb60e-tls-certs\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.022071 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.021961    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-dshm\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.022143 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.022083    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-tmp-dir\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.022207 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.022155    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-model-cache\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.022207 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.022195    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-home\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.022346 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.022331    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqlhn\" (UniqueName: \"kubernetes.io/projected/1d7e0114-2894-4398-92ab-347fbe0eb60e-kube-api-access-kqlhn\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.052157 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.052120    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:03.123334 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.123297    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-dshm\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.123501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.123347    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-tmp-dir\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.123501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.123364    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-model-cache\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.123501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.123391    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-home\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.123501 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.123470    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqlhn\" (UniqueName: \"kubernetes.io/projected/1d7e0114-2894-4398-92ab-347fbe0eb60e-kube-api-access-kqlhn\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.123753 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.123564    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d7e0114-2894-4398-92ab-347fbe0eb60e-tls-certs\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.123856 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.123822    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-tmp-dir\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.123981 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.123858    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-model-cache\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.123981 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.123891    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-home\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.125797 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.125780    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-dshm\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.125947 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.125928    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d7e0114-2894-4398-92ab-347fbe0eb60e-tls-certs\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.185287 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.185232    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqlhn\" (UniqueName: \"kubernetes.io/projected/1d7e0114-2894-4398-92ab-347fbe0eb60e-kube-api-access-kqlhn\") pod \"e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") " pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.199137 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.199104    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:03.577566 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.577540    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"]
Oct 30 22:57:03.579581 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:57:03.579555    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d7e0114_2894_4398_92ab_347fbe0eb60e.slice/crio-7306c9d837629c248ad4c7412cb182f9b96c5efde6b754af9aad62b7c592fd6a WatchSource:0}: Error finding container 7306c9d837629c248ad4c7412cb182f9b96c5efde6b754af9aad62b7c592fd6a: Status 404 returned error can't find the container with id 7306c9d837629c248ad4c7412cb182f9b96c5efde6b754af9aad62b7c592fd6a
Oct 30 22:57:03.962413 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.962316    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g" event={"ID":"1d7e0114-2894-4398-92ab-347fbe0eb60e","Type":"ContainerStarted","Data":"d1c13336bca4b899cbce87bd29a11eefaabc71241459a57a815943184e3d547d"}
Oct 30 22:57:03.962413 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:03.962364    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g" event={"ID":"1d7e0114-2894-4398-92ab-347fbe0eb60e","Type":"ContainerStarted","Data":"7306c9d837629c248ad4c7412cb182f9b96c5efde6b754af9aad62b7c592fd6a"}
Oct 30 22:57:04.080937 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:04.080880    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g" podStartSLOduration=2.080865583 podStartE2EDuration="2.080865583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:57:04.080075806 +0000 UTC m=+3738.810932961" watchObservedRunningTime="2026-10-30 22:57:04.080865583 +0000 UTC m=+3738.811722725"
Oct 30 22:57:04.199716 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:04.199678    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:07.697891 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:07.697860    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:57:13.160517 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:57:13.160479    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:57:13.200115 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:13.200080    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:13.214279 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:13.214253    5258 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:14.088865 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:14.088836    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:57:26.143384 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:26.143347    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:26.364405 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:26.364377    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:37.163266 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:37.163232    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:37.402459 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:37.402428    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:38.602811 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:38.602771    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:57:43.159621 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:57:43.159553    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:57:46.735072 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:46.735036    5258 scope.go:122] "RemoveContainer" containerID="0bd65493429d52fc168b95c8c0b8abf113754a777a6947481acef645c513d391"
Oct 30 22:57:50.278207 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:50.278163    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:54.584757 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:57:54.584720    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:58:07.206767 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:07.206678    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"]
Oct 30 22:58:07.301859 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:07.301824    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:11.886334 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:11.886296    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:58:13.267613 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:58:13.260053    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:58:22.226690 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.226638    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g" podUID="1d7e0114-2894-4398-92ab-347fbe0eb60e" containerName="main" containerID="cri-o://d1c13336bca4b899cbce87bd29a11eefaabc71241459a57a815943184e3d547d" gracePeriod=45
Oct 30 22:58:22.495816 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.495792    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:58:22.587832 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.587802    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1d7e0114-2894-4398-92ab-347fbe0eb60e-tls-certs\" (UniqueName: \"kubernetes.io/secret/1d7e0114-2894-4398-92ab-347fbe0eb60e-tls-certs\") pod \"1d7e0114-2894-4398-92ab-347fbe0eb60e\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") "
Oct 30 22:58:22.588005 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.587988    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-tmp-dir\") pod \"1d7e0114-2894-4398-92ab-347fbe0eb60e\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") "
Oct 30 22:58:22.588059 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.588041    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-home\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-home\") pod \"1d7e0114-2894-4398-92ab-347fbe0eb60e\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") "
Oct 30 22:58:22.588119 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.588102    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d7e0114-2894-4398-92ab-347fbe0eb60e-kube-api-access-kqlhn\" (UniqueName: \"kubernetes.io/projected/1d7e0114-2894-4398-92ab-347fbe0eb60e-kube-api-access-kqlhn\") pod \"1d7e0114-2894-4398-92ab-347fbe0eb60e\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") "
Oct 30 22:58:22.588181 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.588165    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-model-cache\") pod \"1d7e0114-2894-4398-92ab-347fbe0eb60e\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") "
Oct 30 22:58:22.588240 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.588205    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-tmp-dir" pod "1d7e0114-2894-4398-92ab-347fbe0eb60e" (UID: "1d7e0114-2894-4398-92ab-347fbe0eb60e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:58:22.588240 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.588225    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-dshm\") pod \"1d7e0114-2894-4398-92ab-347fbe0eb60e\" (UID: \"1d7e0114-2894-4398-92ab-347fbe0eb60e\") "
Oct 30 22:58:22.588364 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.588337    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-home" pod "1d7e0114-2894-4398-92ab-347fbe0eb60e" (UID: "1d7e0114-2894-4398-92ab-347fbe0eb60e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:58:22.588431 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.588384    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-model-cache" pod "1d7e0114-2894-4398-92ab-347fbe0eb60e" (UID: "1d7e0114-2894-4398-92ab-347fbe0eb60e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:58:22.588635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.588614    5258 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-home\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:58:22.588635 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.588634    5258 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-model-cache\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:58:22.588836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.588643    5258 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-tmp-dir\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:58:22.590124 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.590101    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d7e0114-2894-4398-92ab-347fbe0eb60e-tls-certs" pod "1d7e0114-2894-4398-92ab-347fbe0eb60e" (UID: "1d7e0114-2894-4398-92ab-347fbe0eb60e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:58:22.590304 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.590269    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-dshm" pod "1d7e0114-2894-4398-92ab-347fbe0eb60e" (UID: "1d7e0114-2894-4398-92ab-347fbe0eb60e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:58:22.590395 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.590303    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d7e0114-2894-4398-92ab-347fbe0eb60e-kube-api-access-kqlhn" pod "1d7e0114-2894-4398-92ab-347fbe0eb60e" (UID: "1d7e0114-2894-4398-92ab-347fbe0eb60e"). InnerVolumeSpecName "kube-api-access-kqlhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:58:22.686421 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.686376    5258 generic.go:356] "Generic (PLEG): container finished" podID="1d7e0114-2894-4398-92ab-347fbe0eb60e" containerID="d1c13336bca4b899cbce87bd29a11eefaabc71241459a57a815943184e3d547d" exitCode=0
Oct 30 22:58:22.686641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.686431    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"
Oct 30 22:58:22.686641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.686462    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g" event={"ID":"1d7e0114-2894-4398-92ab-347fbe0eb60e","Type":"ContainerDied","Data":"d1c13336bca4b899cbce87bd29a11eefaabc71241459a57a815943184e3d547d"}
Oct 30 22:58:22.686641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.686511    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g" event={"ID":"1d7e0114-2894-4398-92ab-347fbe0eb60e","Type":"ContainerDied","Data":"7306c9d837629c248ad4c7412cb182f9b96c5efde6b754af9aad62b7c592fd6a"}
Oct 30 22:58:22.686641 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.686535    5258 scope.go:122] "RemoveContainer" containerID="d1c13336bca4b899cbce87bd29a11eefaabc71241459a57a815943184e3d547d"
Oct 30 22:58:22.689390 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.689364    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqlhn\" (UniqueName: \"kubernetes.io/projected/1d7e0114-2894-4398-92ab-347fbe0eb60e-kube-api-access-kqlhn\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:58:22.689511 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.689396    5258 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d7e0114-2894-4398-92ab-347fbe0eb60e-dshm\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:58:22.689511 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.689412    5258 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d7e0114-2894-4398-92ab-347fbe0eb60e-tls-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:58:22.696903 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.696887    5258 scope.go:122] "RemoveContainer" containerID="d1c13336bca4b899cbce87bd29a11eefaabc71241459a57a815943184e3d547d"
Oct 30 22:58:22.697170 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:58:22.697151    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1c13336bca4b899cbce87bd29a11eefaabc71241459a57a815943184e3d547d\": container with ID starting with d1c13336bca4b899cbce87bd29a11eefaabc71241459a57a815943184e3d547d not found: ID does not exist" containerID="d1c13336bca4b899cbce87bd29a11eefaabc71241459a57a815943184e3d547d"
Oct 30 22:58:22.697225 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.697181    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c13336bca4b899cbce87bd29a11eefaabc71241459a57a815943184e3d547d"} err="failed to get container status \"d1c13336bca4b899cbce87bd29a11eefaabc71241459a57a815943184e3d547d\": rpc error: code = NotFound desc = could not find container \"d1c13336bca4b899cbce87bd29a11eefaabc71241459a57a815943184e3d547d\": container with ID starting with d1c13336bca4b899cbce87bd29a11eefaabc71241459a57a815943184e3d547d not found: ID does not exist"
Oct 30 22:58:22.858309 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.858274    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"]
Oct 30 22:58:22.864179 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:22.864151    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-4ab1c912-kserve-687498dcb9-74c7g"]
Oct 30 22:58:23.380517 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:23.380475    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d7e0114-2894-4398-92ab-347fbe0eb60e" path="/var/lib/kubelet/pods/1d7e0114-2894-4398-92ab-347fbe0eb60e/volumes"
Oct 30 22:58:24.278862 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:24.278824    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:58:35.888051 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:35.888016    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:58:37.513045 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:37.513014    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:43.161493 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:58:43.161452    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:58:46.572210 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:46.572174    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:57.168724 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.168687    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:58:57.680676 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.680629    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"]
Oct 30 22:58:57.681342 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.681316    5258 cpu_manager.go:414] "containerMap: removing container" podUID="1d7e0114-2894-4398-92ab-347fbe0eb60e" containerName="main"
Oct 30 22:58:57.681524 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.681505    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d7e0114-2894-4398-92ab-347fbe0eb60e" containerName="main"
Oct 30 22:58:57.681784 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.681764    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d7e0114-2894-4398-92ab-347fbe0eb60e" containerName="main"
Oct 30 22:58:57.684995 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.684975    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:58:57.703636 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.703613    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"]
Oct 30 22:58:57.707097 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.707080    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:57.750865 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.750831    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zj8wn\""
Oct 30 22:58:57.782440 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.782408    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81b76b50-29e5-459b-a1ef-f1554dbb2020-maas-api-tls\") pod \"maas-api-54d58dc998-ws4w8\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") " pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:58:57.782654 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.782462    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea67cab-2c56-4a0d-b92b-b733c6cb8c38-maas-api-tls\") pod \"maas-api-768d68dfcd-75gqb\" (UID: \"4ea67cab-2c56-4a0d-b92b-b733c6cb8c38\") " pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:57.782654 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.782619    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b76b50-29e5-459b-a1ef-f1554dbb2020-metrics-certs\") pod \"maas-api-54d58dc998-ws4w8\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") " pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:58:57.782793 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.782680    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njrpj\" (UniqueName: \"kubernetes.io/projected/81b76b50-29e5-459b-a1ef-f1554dbb2020-kube-api-access-njrpj\") pod \"maas-api-54d58dc998-ws4w8\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") " pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:58:57.782793 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.782743    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81b76b50-29e5-459b-a1ef-f1554dbb2020-openshift-service-ca\") pod \"maas-api-54d58dc998-ws4w8\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") " pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:58:57.782916 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.782807    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea67cab-2c56-4a0d-b92b-b733c6cb8c38-metrics-certs\") pod \"maas-api-768d68dfcd-75gqb\" (UID: \"4ea67cab-2c56-4a0d-b92b-b733c6cb8c38\") " pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:57.782916 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.782861    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea67cab-2c56-4a0d-b92b-b733c6cb8c38-openshift-service-ca\") pod \"maas-api-768d68dfcd-75gqb\" (UID: \"4ea67cab-2c56-4a0d-b92b-b733c6cb8c38\") " pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:57.782916 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.782907    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st6s5\" (UniqueName: \"kubernetes.io/projected/4ea67cab-2c56-4a0d-b92b-b733c6cb8c38-kube-api-access-st6s5\") pod \"maas-api-768d68dfcd-75gqb\" (UID: \"4ea67cab-2c56-4a0d-b92b-b733c6cb8c38\") " pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:57.789761 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.789643    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:58:57.789761 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.789716    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 22:58:57.790367 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.790086    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:58:57.790367 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.790165    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 22:58:57.794393 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.794365    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"]
Oct 30 22:58:57.796895 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.796872    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"]
Oct 30 22:58:57.883862 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.883835    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea67cab-2c56-4a0d-b92b-b733c6cb8c38-metrics-certs\") pod \"maas-api-768d68dfcd-75gqb\" (UID: \"4ea67cab-2c56-4a0d-b92b-b733c6cb8c38\") " pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:57.883980 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.883866    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea67cab-2c56-4a0d-b92b-b733c6cb8c38-openshift-service-ca\") pod \"maas-api-768d68dfcd-75gqb\" (UID: \"4ea67cab-2c56-4a0d-b92b-b733c6cb8c38\") " pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:57.883980 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.883886    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st6s5\" (UniqueName: \"kubernetes.io/projected/4ea67cab-2c56-4a0d-b92b-b733c6cb8c38-kube-api-access-st6s5\") pod \"maas-api-768d68dfcd-75gqb\" (UID: \"4ea67cab-2c56-4a0d-b92b-b733c6cb8c38\") " pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:57.883980 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.883906    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81b76b50-29e5-459b-a1ef-f1554dbb2020-maas-api-tls\") pod \"maas-api-54d58dc998-ws4w8\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") " pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:58:57.883980 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.883958    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea67cab-2c56-4a0d-b92b-b733c6cb8c38-maas-api-tls\") pod \"maas-api-768d68dfcd-75gqb\" (UID: \"4ea67cab-2c56-4a0d-b92b-b733c6cb8c38\") " pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:57.884191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.884025    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b76b50-29e5-459b-a1ef-f1554dbb2020-metrics-certs\") pod \"maas-api-54d58dc998-ws4w8\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") " pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:58:57.884191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.884066    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njrpj\" (UniqueName: \"kubernetes.io/projected/81b76b50-29e5-459b-a1ef-f1554dbb2020-kube-api-access-njrpj\") pod \"maas-api-54d58dc998-ws4w8\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") " pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:58:57.884191 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.884108    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81b76b50-29e5-459b-a1ef-f1554dbb2020-openshift-service-ca\") pod \"maas-api-54d58dc998-ws4w8\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") " pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:58:57.884744 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.884716    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea67cab-2c56-4a0d-b92b-b733c6cb8c38-openshift-service-ca\") pod \"maas-api-768d68dfcd-75gqb\" (UID: \"4ea67cab-2c56-4a0d-b92b-b733c6cb8c38\") " pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:57.885580 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.885545    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81b76b50-29e5-459b-a1ef-f1554dbb2020-openshift-service-ca\") pod \"maas-api-54d58dc998-ws4w8\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") " pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:58:57.886620 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.886563    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea67cab-2c56-4a0d-b92b-b733c6cb8c38-metrics-certs\") pod \"maas-api-768d68dfcd-75gqb\" (UID: \"4ea67cab-2c56-4a0d-b92b-b733c6cb8c38\") " pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:57.886721 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.886640    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b76b50-29e5-459b-a1ef-f1554dbb2020-metrics-certs\") pod \"maas-api-54d58dc998-ws4w8\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") " pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:58:57.886721 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.886685    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81b76b50-29e5-459b-a1ef-f1554dbb2020-maas-api-tls\") pod \"maas-api-54d58dc998-ws4w8\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") " pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:58:57.886797 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.886729    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea67cab-2c56-4a0d-b92b-b733c6cb8c38-maas-api-tls\") pod \"maas-api-768d68dfcd-75gqb\" (UID: \"4ea67cab-2c56-4a0d-b92b-b733c6cb8c38\") " pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:57.946486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.946422    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st6s5\" (UniqueName: \"kubernetes.io/projected/4ea67cab-2c56-4a0d-b92b-b733c6cb8c38-kube-api-access-st6s5\") pod \"maas-api-768d68dfcd-75gqb\" (UID: \"4ea67cab-2c56-4a0d-b92b-b733c6cb8c38\") " pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:57.946486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.946458    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njrpj\" (UniqueName: \"kubernetes.io/projected/81b76b50-29e5-459b-a1ef-f1554dbb2020-kube-api-access-njrpj\") pod \"maas-api-54d58dc998-ws4w8\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") " pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:58:57.999486 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:57.999456    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:58:58.019809 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:58.019787    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:58.408342 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:58.408313    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"]
Oct 30 22:58:58.410179 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:58:58.410151    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b76b50_29e5_459b_a1ef_f1554dbb2020.slice/crio-ae79ab500c2cf01648fb2141001f4c4b258558285b4535d11f3ef2c2fde7e652 WatchSource:0}: Error finding container ae79ab500c2cf01648fb2141001f4c4b258558285b4535d11f3ef2c2fde7e652: Status 404 returned error can't find the container with id ae79ab500c2cf01648fb2141001f4c4b258558285b4535d11f3ef2c2fde7e652
Oct 30 22:58:58.411631 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:58.411579    5258 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:58:58.431031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:58.430991    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"]
Oct 30 22:58:58.445830 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:58:58.445807    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea67cab_2c56_4a0d_b92b_b733c6cb8c38.slice/crio-f9f773727114d453d27d14ef44d139c3027577c5ff3a7582a843804d4fdab0d0 WatchSource:0}: Error finding container f9f773727114d453d27d14ef44d139c3027577c5ff3a7582a843804d4fdab0d0: Status 404 returned error can't find the container with id f9f773727114d453d27d14ef44d139c3027577c5ff3a7582a843804d4fdab0d0
Oct 30 22:58:58.918654 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:58.918612    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb" event={"ID":"4ea67cab-2c56-4a0d-b92b-b733c6cb8c38","Type":"ContainerStarted","Data":"f9f773727114d453d27d14ef44d139c3027577c5ff3a7582a843804d4fdab0d0"}
Oct 30 22:58:58.919753 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:58.919724    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8" event={"ID":"81b76b50-29e5-459b-a1ef-f1554dbb2020","Type":"ContainerStarted","Data":"ae79ab500c2cf01648fb2141001f4c4b258558285b4535d11f3ef2c2fde7e652"}
Oct 30 22:58:59.928275 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:59.928237    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb" event={"ID":"4ea67cab-2c56-4a0d-b92b-b733c6cb8c38","Type":"ContainerStarted","Data":"1d6bd1ed467c3baab4c80b20ae32e7ae976c7f55216ffc41e287a23c4e36230b"}
Oct 30 22:58:59.928763 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:59.928305    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:58:59.929917 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:59.929888    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8" event={"ID":"81b76b50-29e5-459b-a1ef-f1554dbb2020","Type":"ContainerStarted","Data":"45e2f40288872873b175b6d4b78b288662b426748c2bf45edf93aad1f3742e48"}
Oct 30 22:58:59.930046 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:58:59.929966    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:59:00.049669 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:00.049620    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb" podStartSLOduration=2.1998415 podStartE2EDuration="3.049603747s" totalImagesPullingTime="849.762247ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:59:00.04819305 +0000 UTC m=+3854.779050192" watchObservedRunningTime="2026-10-30 22:59:00.049603747 +0000 UTC m=+3854.780460891"
Oct 30 22:59:00.168003 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:00.167704    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8" podStartSLOduration=2.312206599 podStartE2EDuration="3.167684654s" totalImagesPullingTime="855.478055ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:59:00.167613441 +0000 UTC m=+3854.898470576" watchObservedRunningTime="2026-10-30 22:59:00.167684654 +0000 UTC m=+3854.898541799"
Oct 30 22:59:04.539622 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:04.539580    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:05.195467 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:05.195430    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:05.422380 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:05.422338    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:05.942053 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:05.942020    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-768d68dfcd-75gqb"
Oct 30 22:59:05.942502 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:05.942479    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:59:06.116286 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.116245    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"]
Oct 30 22:59:06.116480 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.116441    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8" podUID="81b76b50-29e5-459b-a1ef-f1554dbb2020" containerName="maas-api" containerID="cri-o://45e2f40288872873b175b6d4b78b288662b426748c2bf45edf93aad1f3742e48" gracePeriod=30
Oct 30 22:59:06.381578 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.381553    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:59:06.578926 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.578895    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81b76b50-29e5-459b-a1ef-f1554dbb2020-kube-api-access-njrpj\" (UniqueName: \"kubernetes.io/projected/81b76b50-29e5-459b-a1ef-f1554dbb2020-kube-api-access-njrpj\") pod \"81b76b50-29e5-459b-a1ef-f1554dbb2020\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") "
Oct 30 22:59:06.579192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.579020    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81b76b50-29e5-459b-a1ef-f1554dbb2020-metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b76b50-29e5-459b-a1ef-f1554dbb2020-metrics-certs\") pod \"81b76b50-29e5-459b-a1ef-f1554dbb2020\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") "
Oct 30 22:59:06.579192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.579095    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81b76b50-29e5-459b-a1ef-f1554dbb2020-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81b76b50-29e5-459b-a1ef-f1554dbb2020-openshift-service-ca\") pod \"81b76b50-29e5-459b-a1ef-f1554dbb2020\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") "
Oct 30 22:59:06.579192 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.579131    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81b76b50-29e5-459b-a1ef-f1554dbb2020-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81b76b50-29e5-459b-a1ef-f1554dbb2020-maas-api-tls\") pod \"81b76b50-29e5-459b-a1ef-f1554dbb2020\" (UID: \"81b76b50-29e5-459b-a1ef-f1554dbb2020\") "
Oct 30 22:59:06.579650 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.579585    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81b76b50-29e5-459b-a1ef-f1554dbb2020-openshift-service-ca" pod "81b76b50-29e5-459b-a1ef-f1554dbb2020" (UID: "81b76b50-29e5-459b-a1ef-f1554dbb2020"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:59:06.581307 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.581279    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81b76b50-29e5-459b-a1ef-f1554dbb2020-kube-api-access-njrpj" pod "81b76b50-29e5-459b-a1ef-f1554dbb2020" (UID: "81b76b50-29e5-459b-a1ef-f1554dbb2020"). InnerVolumeSpecName "kube-api-access-njrpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:59:06.581411 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.581283    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b76b50-29e5-459b-a1ef-f1554dbb2020-metrics-certs" pod "81b76b50-29e5-459b-a1ef-f1554dbb2020" (UID: "81b76b50-29e5-459b-a1ef-f1554dbb2020"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:59:06.581465 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.581421    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b76b50-29e5-459b-a1ef-f1554dbb2020-maas-api-tls" pod "81b76b50-29e5-459b-a1ef-f1554dbb2020" (UID: "81b76b50-29e5-459b-a1ef-f1554dbb2020"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:59:06.680385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.680348    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njrpj\" (UniqueName: \"kubernetes.io/projected/81b76b50-29e5-459b-a1ef-f1554dbb2020-kube-api-access-njrpj\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:06.680385 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.680381    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81b76b50-29e5-459b-a1ef-f1554dbb2020-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:06.680620 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.680394    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81b76b50-29e5-459b-a1ef-f1554dbb2020-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:06.680620 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.680407    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81b76b50-29e5-459b-a1ef-f1554dbb2020-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:06.973879 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.973789    5258 generic.go:356] "Generic (PLEG): container finished" podID="81b76b50-29e5-459b-a1ef-f1554dbb2020" containerID="45e2f40288872873b175b6d4b78b288662b426748c2bf45edf93aad1f3742e48" exitCode=0
Oct 30 22:59:06.973879 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.973846    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"
Oct 30 22:59:06.973879 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.973872    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8" event={"ID":"81b76b50-29e5-459b-a1ef-f1554dbb2020","Type":"ContainerDied","Data":"45e2f40288872873b175b6d4b78b288662b426748c2bf45edf93aad1f3742e48"}
Oct 30 22:59:06.974478 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.973923    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8" event={"ID":"81b76b50-29e5-459b-a1ef-f1554dbb2020","Type":"ContainerDied","Data":"ae79ab500c2cf01648fb2141001f4c4b258558285b4535d11f3ef2c2fde7e652"}
Oct 30 22:59:06.974478 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.973945    5258 scope.go:122] "RemoveContainer" containerID="45e2f40288872873b175b6d4b78b288662b426748c2bf45edf93aad1f3742e48"
Oct 30 22:59:06.984833 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.984813    5258 scope.go:122] "RemoveContainer" containerID="45e2f40288872873b175b6d4b78b288662b426748c2bf45edf93aad1f3742e48"
Oct 30 22:59:06.985092 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:59:06.985069    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45e2f40288872873b175b6d4b78b288662b426748c2bf45edf93aad1f3742e48\": container with ID starting with 45e2f40288872873b175b6d4b78b288662b426748c2bf45edf93aad1f3742e48 not found: ID does not exist" containerID="45e2f40288872873b175b6d4b78b288662b426748c2bf45edf93aad1f3742e48"
Oct 30 22:59:06.985151 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:06.985102    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e2f40288872873b175b6d4b78b288662b426748c2bf45edf93aad1f3742e48"} err="failed to get container status \"45e2f40288872873b175b6d4b78b288662b426748c2bf45edf93aad1f3742e48\": rpc error: code = NotFound desc = could not find container \"45e2f40288872873b175b6d4b78b288662b426748c2bf45edf93aad1f3742e48\": container with ID starting with 45e2f40288872873b175b6d4b78b288662b426748c2bf45edf93aad1f3742e48 not found: ID does not exist"
Oct 30 22:59:07.140951 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:07.140910    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"]
Oct 30 22:59:07.190510 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:07.190480    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-54d58dc998-ws4w8"]
Oct 30 22:59:07.381252 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:07.381223    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81b76b50-29e5-459b-a1ef-f1554dbb2020" path="/var/lib/kubelet/pods/81b76b50-29e5-459b-a1ef-f1554dbb2020/volumes"
Oct 30 22:59:08.847907 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:08.847875    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:09.136778 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:09.136690    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:12.073037 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:12.073000    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:12.311339 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:12.311308    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:13.129667 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.129633    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"]
Oct 30 22:59:13.130092 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.130078    5258 cpu_manager.go:414] "containerMap: removing container" podUID="81b76b50-29e5-459b-a1ef-f1554dbb2020" containerName="maas-api"
Oct 30 22:59:13.130140 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.130093    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81b76b50-29e5-459b-a1ef-f1554dbb2020" containerName="maas-api"
Oct 30 22:59:13.130203 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.130194    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="81b76b50-29e5-459b-a1ef-f1554dbb2020" containerName="maas-api"
Oct 30 22:59:13.134534 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.134513    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:13.161675 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:59:13.161646    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:59:13.189936 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.189910    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5b8bfacd-serving-cert\""
Oct 30 22:59:13.233910 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.233885    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-metrics-certs\") pod \"maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:13.234046 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.233919    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g2xj\" (UniqueName: \"kubernetes.io/projected/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-kube-api-access-8g2xj\") pod \"maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:13.234046 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.233947    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-maas-api-tls\") pod \"maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:13.234167 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.234145    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-openshift-service-ca\") pod \"maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:13.239164 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.239142    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"]
Oct 30 22:59:13.334836 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.334797    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-openshift-service-ca\") pod \"maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:13.335031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.334857    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-metrics-certs\") pod \"maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:13.335031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.334889    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g2xj\" (UniqueName: \"kubernetes.io/projected/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-kube-api-access-8g2xj\") pod \"maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:13.335031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.334929    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-maas-api-tls\") pod \"maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:13.335231 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:59:13.335097    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-serving-cert: secret "maas-api-e2e-ait-5b8bfacd-serving-cert" not found
Oct 30 22:59:13.335231 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:59:13.335183    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-maas-api-tls podName:d1edd1ba-32b8-40bd-a17d-dbe9b0896293 nodeName:}" failed. No retries permitted until 2026-10-30 22:59:13.835161715 +0000 UTC m=+3868.566018839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-maas-api-tls") pod "maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5" (UID: "d1edd1ba-32b8-40bd-a17d-dbe9b0896293") : secret "maas-api-e2e-ait-5b8bfacd-serving-cert" not found
Oct 30 22:59:13.335675 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.335658    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-openshift-service-ca\") pod \"maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:13.337226 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.337207    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-metrics-certs\") pod \"maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:13.397801 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.397705    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g2xj\" (UniqueName: \"kubernetes.io/projected/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-kube-api-access-8g2xj\") pod \"maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:13.423468 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.423442    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:13.644772 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.644742    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:13.838926 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.838891    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-maas-api-tls\") pod \"maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:13.841322 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:13.841300    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-maas-api-tls\") pod \"maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:14.048876 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:14.048845    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:14.429496 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:14.429467    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"]
Oct 30 22:59:14.431386 ip-10-0-137-32 kubenswrapper[5258]: W1030 22:59:14.431354    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1edd1ba_32b8_40bd_a17d_dbe9b0896293.slice/crio-08c7eccee10d72a69d0e189570b4e57793f0f684e5f1bb8081bbe3765c4f1d27 WatchSource:0}: Error finding container 08c7eccee10d72a69d0e189570b4e57793f0f684e5f1bb8081bbe3765c4f1d27: Status 404 returned error can't find the container with id 08c7eccee10d72a69d0e189570b4e57793f0f684e5f1bb8081bbe3765c4f1d27
Oct 30 22:59:15.025022 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:15.024988    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5" event={"ID":"d1edd1ba-32b8-40bd-a17d-dbe9b0896293","Type":"ContainerStarted","Data":"08c7eccee10d72a69d0e189570b4e57793f0f684e5f1bb8081bbe3765c4f1d27"}
Oct 30 22:59:16.033031 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:16.032982    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5" event={"ID":"d1edd1ba-32b8-40bd-a17d-dbe9b0896293","Type":"ContainerStarted","Data":"14b02f4818af84b88db1b2a12d71be2df5b5bad5210eafc113d1487129a22251"}
Oct 30 22:59:16.033473 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:16.033070    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:16.155939 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:16.155871    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5" podStartSLOduration=2.32039504 podStartE2EDuration="3.15585244s" totalImagesPullingTime="835.4574ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:59:16.153131608 +0000 UTC m=+3870.883988752" watchObservedRunningTime="2026-10-30 22:59:16.15585244 +0000 UTC m=+3870.886709584"
Oct 30 22:59:18.866320 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:18.866281    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:21.702294 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:21.702255    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 22:59:22.044208 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:22.044119    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 22:59:23.718487 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:23.718454    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:23.939063 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:23.939031    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:28.959078 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:28.958994    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:34.273423 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:34.273385    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:37.859048 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:37.859010    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:39.470928 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:39.470881    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:43.160212 ip-10-0-137-32 kubenswrapper[5258]: E1030 22:59:43.160163    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 22:59:44.457559 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:44.457517    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:46.003620 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:46.003571    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:59:46.012364 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:46.012339    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 22:59:49.282576 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:49.282523    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:54.347789 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:54.347751    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:57.225419 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:57.225376    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:57.517299 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:57.517211    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:59.273870 ip-10-0-137-32 kubenswrapper[5258]: I1030 22:59:59.273829    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:03.558253 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:03.558220    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"]
Oct 30 23:00:03.558685 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:03.558454    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5" podUID="d1edd1ba-32b8-40bd-a17d-dbe9b0896293" containerName="maas-api" containerID="cri-o://14b02f4818af84b88db1b2a12d71be2df5b5bad5210eafc113d1487129a22251" gracePeriod=30
Oct 30 23:00:03.739727 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:03.739692    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:03.827568 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:03.827536    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 23:00:03.939812 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:03.939775    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-kube-api-access-8g2xj\" (UniqueName: \"kubernetes.io/projected/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-kube-api-access-8g2xj\") pod \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") "
Oct 30 23:00:03.940006 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:03.939826    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-openshift-service-ca\") pod \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") "
Oct 30 23:00:03.940006 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:03.939863    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-maas-api-tls\") pod \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") "
Oct 30 23:00:03.940006 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:03.939911    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-metrics-certs\") pod \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\" (UID: \"d1edd1ba-32b8-40bd-a17d-dbe9b0896293\") "
Oct 30 23:00:03.940924 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:03.940884    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-openshift-service-ca" pod "d1edd1ba-32b8-40bd-a17d-dbe9b0896293" (UID: "d1edd1ba-32b8-40bd-a17d-dbe9b0896293"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:00:03.942888 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:03.942855    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-kube-api-access-8g2xj" pod "d1edd1ba-32b8-40bd-a17d-dbe9b0896293" (UID: "d1edd1ba-32b8-40bd-a17d-dbe9b0896293"). InnerVolumeSpecName "kube-api-access-8g2xj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:00:03.942991 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:03.942958    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-metrics-certs" pod "d1edd1ba-32b8-40bd-a17d-dbe9b0896293" (UID: "d1edd1ba-32b8-40bd-a17d-dbe9b0896293"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:00:03.943701 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:03.943678    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-maas-api-tls" pod "d1edd1ba-32b8-40bd-a17d-dbe9b0896293" (UID: "d1edd1ba-32b8-40bd-a17d-dbe9b0896293"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:00:04.009536 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:04.009501    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:04.041224 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:04.041193    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g2xj\" (UniqueName: \"kubernetes.io/projected/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-kube-api-access-8g2xj\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:00:04.041224 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:04.041219    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:00:04.041410 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:04.041230    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:00:04.041410 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:04.041240    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1edd1ba-32b8-40bd-a17d-dbe9b0896293-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:00:04.308635 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:04.308572    5258 generic.go:356] "Generic (PLEG): container finished" podID="d1edd1ba-32b8-40bd-a17d-dbe9b0896293" containerID="14b02f4818af84b88db1b2a12d71be2df5b5bad5210eafc113d1487129a22251" exitCode=0
Oct 30 23:00:04.308635 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:04.308619    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5" event={"ID":"d1edd1ba-32b8-40bd-a17d-dbe9b0896293","Type":"ContainerDied","Data":"14b02f4818af84b88db1b2a12d71be2df5b5bad5210eafc113d1487129a22251"}
Oct 30 23:00:04.308907 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:04.308648    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"
Oct 30 23:00:04.308907 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:04.308690    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5" event={"ID":"d1edd1ba-32b8-40bd-a17d-dbe9b0896293","Type":"ContainerDied","Data":"08c7eccee10d72a69d0e189570b4e57793f0f684e5f1bb8081bbe3765c4f1d27"}
Oct 30 23:00:04.308907 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:04.308721    5258 scope.go:122] "RemoveContainer" containerID="14b02f4818af84b88db1b2a12d71be2df5b5bad5210eafc113d1487129a22251"
Oct 30 23:00:04.318707 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:04.318690    5258 scope.go:122] "RemoveContainer" containerID="14b02f4818af84b88db1b2a12d71be2df5b5bad5210eafc113d1487129a22251"
Oct 30 23:00:04.318998 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:00:04.318980    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14b02f4818af84b88db1b2a12d71be2df5b5bad5210eafc113d1487129a22251\": container with ID starting with 14b02f4818af84b88db1b2a12d71be2df5b5bad5210eafc113d1487129a22251 not found: ID does not exist" containerID="14b02f4818af84b88db1b2a12d71be2df5b5bad5210eafc113d1487129a22251"
Oct 30 23:00:04.319094 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:04.319010    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14b02f4818af84b88db1b2a12d71be2df5b5bad5210eafc113d1487129a22251"} err="failed to get container status \"14b02f4818af84b88db1b2a12d71be2df5b5bad5210eafc113d1487129a22251\": rpc error: code = NotFound desc = could not find container \"14b02f4818af84b88db1b2a12d71be2df5b5bad5210eafc113d1487129a22251\": container with ID starting with 14b02f4818af84b88db1b2a12d71be2df5b5bad5210eafc113d1487129a22251 not found: ID does not exist"
Oct 30 23:00:04.493821 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:04.493781    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"]
Oct 30 23:00:04.499001 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:04.498955    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5b8bfacd-849d5d74-mdpg5"]
Oct 30 23:00:05.236625 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:05.236569    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:05.387089 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:05.387052    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d1edd1ba-32b8-40bd-a17d-dbe9b0896293" path="/var/lib/kubelet/pods/d1edd1ba-32b8-40bd-a17d-dbe9b0896293/volumes"
Oct 30 23:00:05.523249 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:05.523158    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:06.548027 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:06.547984    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:07.870284 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:07.870248    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:08.574963 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:08.574912    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:08.929798 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:08.929677    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:10.123066 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:10.123031    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 23:00:12.885775 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:12.885734    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:13.160492 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:00:13.160410    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 23:00:13.168045 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:13.167955    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:15.240982 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.240945    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"]
Oct 30 23:00:15.241437 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.241423    5258 cpu_manager.go:414] "containerMap: removing container" podUID="d1edd1ba-32b8-40bd-a17d-dbe9b0896293" containerName="maas-api"
Oct 30 23:00:15.241481 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.241438    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d1edd1ba-32b8-40bd-a17d-dbe9b0896293" containerName="maas-api"
Oct 30 23:00:15.241540 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.241530    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="d1edd1ba-32b8-40bd-a17d-dbe9b0896293" containerName="maas-api"
Oct 30 23:00:15.244800 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.244780    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:15.306180 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.306151    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"]
Oct 30 23:00:15.347870 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.347835    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c880ef8-e265-4af5-9d0c-8915c3c15417-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:15.348028 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.347882    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:15.348028 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.348001    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-metrics-certs\") pod \"maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:15.348169 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.348145    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55j4h\" (UniqueName: \"kubernetes.io/projected/0c880ef8-e265-4af5-9d0c-8915c3c15417-kube-api-access-55j4h\") pod \"maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:15.351080 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.351058    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-authcfg-http-de0687-serving-cert\""
Oct 30 23:00:15.449200 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.449163    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-metrics-certs\") pod \"maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:15.449384 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.449276    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55j4h\" (UniqueName: \"kubernetes.io/projected/0c880ef8-e265-4af5-9d0c-8915c3c15417-kube-api-access-55j4h\") pod \"maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:15.449384 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.449327    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c880ef8-e265-4af5-9d0c-8915c3c15417-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:15.449384 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.449360    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:15.449557 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:00:15.449519    5258 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-serving-cert: secret "maas-api-e2e-authcfg-http-de0687-serving-cert" not found
Oct 30 23:00:15.449657 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:00:15.449639    5258 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-maas-api-tls podName:0c880ef8-e265-4af5-9d0c-8915c3c15417 nodeName:}" failed. No retries permitted until 2026-10-30 23:00:15.949615003 +0000 UTC m=+3930.680472138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-maas-api-tls") pod "maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx" (UID: "0c880ef8-e265-4af5-9d0c-8915c3c15417") : secret "maas-api-e2e-authcfg-http-de0687-serving-cert" not found
Oct 30 23:00:15.450105 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.450087    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c880ef8-e265-4af5-9d0c-8915c3c15417-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:15.451700 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.451674    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-metrics-certs\") pod \"maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:15.512030 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.511959    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55j4h\" (UniqueName: \"kubernetes.io/projected/0c880ef8-e265-4af5-9d0c-8915c3c15417-kube-api-access-55j4h\") pod \"maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:15.554743 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.554702    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:15.931066 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.931029    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:15.954140 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.954109    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:15.956460 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:15.956436    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:16.157778 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:16.157748    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:16.210817 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:16.210662    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:16.441785 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:16.441747    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:16.557820 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:16.557794    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"]
Oct 30 23:00:16.560161 ip-10-0-137-32 kubenswrapper[5258]: W1030 23:00:16.560131    5258 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c880ef8_e265_4af5_9d0c_8915c3c15417.slice/crio-ca2cb7c82761531d3e9d7e511ae751915ff4f39486497d37b1f42f15b67a9a57 WatchSource:0}: Error finding container ca2cb7c82761531d3e9d7e511ae751915ff4f39486497d37b1f42f15b67a9a57: Status 404 returned error can't find the container with id ca2cb7c82761531d3e9d7e511ae751915ff4f39486497d37b1f42f15b67a9a57
Oct 30 23:00:17.401011 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:17.400962    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx" event={"ID":"0c880ef8-e265-4af5-9d0c-8915c3c15417","Type":"ContainerStarted","Data":"ca2cb7c82761531d3e9d7e511ae751915ff4f39486497d37b1f42f15b67a9a57"}
Oct 30 23:00:18.407853 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:18.407805    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx" event={"ID":"0c880ef8-e265-4af5-9d0c-8915c3c15417","Type":"ContainerStarted","Data":"6fc2fcac3237ea2343dcd539e7abc568c909bc31720d5aff4bea3fb60d7738a9"}
Oct 30 23:00:18.408281 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:18.407952    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:18.535908 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:18.535859    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx" podStartSLOduration=2.664023375 podStartE2EDuration="3.535843838s" totalImagesPullingTime="871.820463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 23:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:00:18.533652529 +0000 UTC m=+3933.264509696" watchObservedRunningTime="2026-10-30 23:00:18.535843838 +0000 UTC m=+3933.266700981"
Oct 30 23:00:20.879015 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:20.878974    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:22.714237 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:22.714196    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 23:00:24.418554 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:24.418518    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:00:26.066767 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:26.066722    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:30.961201 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:30.961154    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:32.591279 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:32.591245    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:36.227109 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:36.227074    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:38.251202 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:38.251161    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:38.484925 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:38.484886    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:41.091558 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:41.091522    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:43.163355 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:00:43.163317    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 23:00:46.089307 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:46.089264    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:51.041192 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:51.041152    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:55.939623 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:00:55.939528    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:01:00.871412 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:01:00.871370    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:01:05.842935 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:01:05.842899    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:01:10.743586 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:01:10.743547    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:01:13.160295 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:01:13.160258    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 23:01:15.750325 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:01:15.750277    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:01:20.690243 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:01:20.690209    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:01:25.762969 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:01:25.762932    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:01:30.771271 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:01:30.771237    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:01:35.764318 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:01:35.764276    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:01:38.535166 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:01:38.535127    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:01:40.676499 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:01:40.676452    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:01:43.161415 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:01:43.161378    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 23:01:45.653164 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:01:45.653121    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:01:50.624428 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:01:50.624391    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:01:55.905834 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:01:55.905792    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:01.160785 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:01.160749    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:05.283837 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:05.283786    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:05.551486 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:05.551391    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:13.159682 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:02:13.159644    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 23:02:15.054905 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.054866    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"]
Oct 30 23:02:15.055393 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.055066    5258 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx" podUID="0c880ef8-e265-4af5-9d0c-8915c3c15417" containerName="maas-api" containerID="cri-o://6fc2fcac3237ea2343dcd539e7abc568c909bc31720d5aff4bea3fb60d7738a9" gracePeriod=30
Oct 30 23:02:15.251478 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.251444    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:15.320699 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.320677    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:02:15.409872 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.409833    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0c880ef8-e265-4af5-9d0c-8915c3c15417-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c880ef8-e265-4af5-9d0c-8915c3c15417-openshift-service-ca\") pod \"0c880ef8-e265-4af5-9d0c-8915c3c15417\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") "
Oct 30 23:02:15.410053 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.409890    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-maas-api-tls\") pod \"0c880ef8-e265-4af5-9d0c-8915c3c15417\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") "
Oct 30 23:02:15.410053 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.409995    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-metrics-certs\") pod \"0c880ef8-e265-4af5-9d0c-8915c3c15417\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") "
Oct 30 23:02:15.410158 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.410075    5258 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c880ef8-e265-4af5-9d0c-8915c3c15417-kube-api-access-55j4h\" (UniqueName: \"kubernetes.io/projected/0c880ef8-e265-4af5-9d0c-8915c3c15417-kube-api-access-55j4h\") pod \"0c880ef8-e265-4af5-9d0c-8915c3c15417\" (UID: \"0c880ef8-e265-4af5-9d0c-8915c3c15417\") "
Oct 30 23:02:15.410223 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.410182    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c880ef8-e265-4af5-9d0c-8915c3c15417-openshift-service-ca" pod "0c880ef8-e265-4af5-9d0c-8915c3c15417" (UID: "0c880ef8-e265-4af5-9d0c-8915c3c15417"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 23:02:15.410333 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.410316    5258 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c880ef8-e265-4af5-9d0c-8915c3c15417-openshift-service-ca\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:02:15.412045 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.412008    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-metrics-certs" pod "0c880ef8-e265-4af5-9d0c-8915c3c15417" (UID: "0c880ef8-e265-4af5-9d0c-8915c3c15417"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:02:15.412165 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.412111    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-maas-api-tls" pod "0c880ef8-e265-4af5-9d0c-8915c3c15417" (UID: "0c880ef8-e265-4af5-9d0c-8915c3c15417"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 23:02:15.412165 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.412110    5258 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c880ef8-e265-4af5-9d0c-8915c3c15417-kube-api-access-55j4h" pod "0c880ef8-e265-4af5-9d0c-8915c3c15417" (UID: "0c880ef8-e265-4af5-9d0c-8915c3c15417"). InnerVolumeSpecName "kube-api-access-55j4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 23:02:15.511007 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.510974    5258 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-metrics-certs\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:02:15.511007 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.511006    5258 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55j4h\" (UniqueName: \"kubernetes.io/projected/0c880ef8-e265-4af5-9d0c-8915c3c15417-kube-api-access-55j4h\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:02:15.511007 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:15.511021    5258 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c880ef8-e265-4af5-9d0c-8915c3c15417-maas-api-tls\") on node \"ip-10-0-137-32.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 23:02:16.113066 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:16.113028    5258 generic.go:356] "Generic (PLEG): container finished" podID="0c880ef8-e265-4af5-9d0c-8915c3c15417" containerID="6fc2fcac3237ea2343dcd539e7abc568c909bc31720d5aff4bea3fb60d7738a9" exitCode=0
Oct 30 23:02:16.113546 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:16.113096    5258 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"
Oct 30 23:02:16.113546 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:16.113112    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx" event={"ID":"0c880ef8-e265-4af5-9d0c-8915c3c15417","Type":"ContainerDied","Data":"6fc2fcac3237ea2343dcd539e7abc568c909bc31720d5aff4bea3fb60d7738a9"}
Oct 30 23:02:16.113546 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:16.113173    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx" event={"ID":"0c880ef8-e265-4af5-9d0c-8915c3c15417","Type":"ContainerDied","Data":"ca2cb7c82761531d3e9d7e511ae751915ff4f39486497d37b1f42f15b67a9a57"}
Oct 30 23:02:16.113546 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:16.113200    5258 scope.go:122] "RemoveContainer" containerID="6fc2fcac3237ea2343dcd539e7abc568c909bc31720d5aff4bea3fb60d7738a9"
Oct 30 23:02:16.125161 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:16.125145    5258 scope.go:122] "RemoveContainer" containerID="6fc2fcac3237ea2343dcd539e7abc568c909bc31720d5aff4bea3fb60d7738a9"
Oct 30 23:02:16.125437 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:02:16.125414    5258 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fc2fcac3237ea2343dcd539e7abc568c909bc31720d5aff4bea3fb60d7738a9\": container with ID starting with 6fc2fcac3237ea2343dcd539e7abc568c909bc31720d5aff4bea3fb60d7738a9 not found: ID does not exist" containerID="6fc2fcac3237ea2343dcd539e7abc568c909bc31720d5aff4bea3fb60d7738a9"
Oct 30 23:02:16.125483 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:16.125449    5258 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fc2fcac3237ea2343dcd539e7abc568c909bc31720d5aff4bea3fb60d7738a9"} err="failed to get container status \"6fc2fcac3237ea2343dcd539e7abc568c909bc31720d5aff4bea3fb60d7738a9\": rpc error: code = NotFound desc = could not find container \"6fc2fcac3237ea2343dcd539e7abc568c909bc31720d5aff4bea3fb60d7738a9\": container with ID starting with 6fc2fcac3237ea2343dcd539e7abc568c909bc31720d5aff4bea3fb60d7738a9 not found: ID does not exist"
Oct 30 23:02:16.279798 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:16.279760    5258 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"]
Oct 30 23:02:16.329227 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:16.329196    5258 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-de0687-8b6d6c796-4dwvx"]
Oct 30 23:02:16.826565 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:16.826526    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:17.076154 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:17.076122    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:17.379854 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:17.379823    5258 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0c880ef8-e265-4af5-9d0c-8915c3c15417" path="/var/lib/kubelet/pods/0c880ef8-e265-4af5-9d0c-8915c3c15417/volumes"
Oct 30 23:02:17.831174 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:17.831140    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:19.806338 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:19.806307    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 23:02:24.555888 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:24.555843    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:24.796358 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:24.796299    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:25.012680 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:25.012645    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:33.503071 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:33.502993    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 23:02:38.896645 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:38.896606    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:43.160410 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:02:43.160370    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 23:02:44.909749 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:44.909713    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 23:02:48.059742 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:48.059676    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-x6hg4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:02:48.060401 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:48.060355    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-x6hg4" podUID="d804a5f8-76b1-4ac5-bef4-ab73965299f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:02:56.694842 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:02:56.694789    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:03:08.410048 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:08.410005    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 23:03:13.164881 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:03:13.164844    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 23:03:39.343138 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:39.343101    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:03:39.597475 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:39.597385    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:03:40.484542 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:40.484514    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6859d556b5-bq4vb_845284a3-14ec-44c3-b284-ab3fd6b086c3/authorino/0.log"
Oct 30 23:03:41.273261 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:41.273221    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-wpvvx"]
Oct 30 23:03:42.921612 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:42.920713    5258 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-76597d6855-62dtc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.146:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:03:42.921612 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:42.920813    5258 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-76597d6855-62dtc" podUID="8c139cbd-4b47-41c0-b11f-742a3ff3f81b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.146:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:03:43.305677 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:03:43.299821    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 23:03:53.290370 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:53.290337    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-687b4b7474-nmhzz_e900fb86-08e5-49bd-bb58-6e919e6588e0/manager/0.log"
Oct 30 23:03:54.123429 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:54.123400    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-zfzcp_bf99aba5-45ba-42f2-bb30-daa7ee024580/manager/0.log"
Oct 30 23:03:55.598234 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:55.598205    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-768d68dfcd-75gqb_4ea67cab-2c56-4a0d-b92b-b733c6cb8c38/maas-api/0.log"
Oct 30 23:03:58.250742 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:58.250710    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6859d556b5-bq4vb_845284a3-14ec-44c3-b284-ab3fd6b086c3/authorino/0.log"
Oct 30 23:03:58.700563 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:58.700523    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-5s6rv_799ab849-b5eb-4121-b968-daac6c0ca192/manager/0.log"
Oct 30 23:03:58.943797 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:58.943747    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-mssbp_3f26245d-8748-43ec-b93b-aae4d677f50a/manager/0.log"
Oct 30 23:03:59.423961 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:59.423929    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-tr8h9_dc7af4e1-189e-4dd1-9bc7-c4790560a76c/manager/0.log"
Oct 30 23:03:59.733809 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:59.733728    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-wpvvx_87aca691-d489-4340-bba8-c2a24ef6b01a/limitador/0.log"
Oct 30 23:03:59.973765 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:03:59.973733    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-ckfcw_1d2ccf23-0efa-409e-8815-c53ea93de343/manager/0.log"
Oct 30 23:04:00.779614 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:00.779561    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6545b48489p5m4v_ab30c3fd-f2e8-413e-b837-c295e91f4f84/istio-proxy/0.log"
Oct 30 23:04:02.079485 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:02.079445    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-76597d6855-62dtc_8c139cbd-4b47-41c0-b11f-742a3ff3f81b/istio-proxy/0.log"
Oct 30 23:04:03.136082 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:03.136019    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-76597d6855-shttj_9540d501-45f8-42fb-b3e3-da60a19f9301/istio-proxy/0.log"
Oct 30 23:04:03.664264 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:03.664224    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-76597d6855-vfb7s_5c149d2a-e6e0-45fd-978d-a1d5c0137d79/istio-proxy/0.log"
Oct 30 23:04:03.914862 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:03.914785    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-76597d6855-x6hg4_d804a5f8-76b1-4ac5-bef4-ab73965299f6/istio-proxy/1.log"
Oct 30 23:04:04.474292 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:04.474262    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw_d035a377-67b0-4288-8b37-329883c8b58d/istio-proxy/0.log"
Oct 30 23:04:05.169359 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:05.169326    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c6c4f6cbf-rnprt_fb977621-3d73-4a48-bc4c-a50f67da25d6/router/0.log"
Oct 30 23:04:05.708774 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:05.708741    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-76597d6855-x6hg4_d804a5f8-76b1-4ac5-bef4-ab73965299f6/istio-proxy/0.log"
Oct 30 23:04:06.330327 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:06.330292    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9_a7f24980-650b-47e6-9d86-2cf74f4f105d/main/0.log"
Oct 30 23:04:06.899557 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:06.899529    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-dzjzr_2b034e42-8bd5-4442-a7e8-04185f498f2a/main/0.log"
Oct 30 23:04:07.168448 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:07.168364    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-jdp6j_3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a/main/0.log"
Oct 30 23:04:07.449626 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:07.449521    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4_bc19019e-af7f-43bc-8de8-670e7ef903f4/main/0.log"
Oct 30 23:04:08.187255 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:08.187224    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k_0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f/main/0.log"
Oct 30 23:04:09.123006 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:09.122967    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:04:09.211277 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:09.211243    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6859d556b5-bq4vb_845284a3-14ec-44c3-b284-ab3fd6b086c3/authorino/0.log"
Oct 30 23:04:13.160575 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:04:13.160536    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 23:04:19.951854 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:19.951819    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-687b4b7474-nmhzz_e900fb86-08e5-49bd-bb58-6e919e6588e0/manager/0.log"
Oct 30 23:04:20.602661 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:20.602624    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-zfzcp_bf99aba5-45ba-42f2-bb30-daa7ee024580/manager/0.log"
Oct 30 23:04:21.770917 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:21.770882    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-768d68dfcd-75gqb_4ea67cab-2c56-4a0d-b92b-b733c6cb8c38/maas-api/0.log"
Oct 30 23:04:23.971705 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:23.971659    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6859d556b5-bq4vb_845284a3-14ec-44c3-b284-ab3fd6b086c3/authorino/0.log"
Oct 30 23:04:24.433905 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:24.433878    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-5s6rv_799ab849-b5eb-4121-b968-daac6c0ca192/manager/0.log"
Oct 30 23:04:24.667290 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:24.667260    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-mssbp_3f26245d-8748-43ec-b93b-aae4d677f50a/manager/0.log"
Oct 30 23:04:25.119790 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:25.119758    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-tr8h9_dc7af4e1-189e-4dd1-9bc7-c4790560a76c/manager/0.log"
Oct 30 23:04:25.435950 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:25.435864    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-wpvvx_87aca691-d489-4340-bba8-c2a24ef6b01a/limitador/0.log"
Oct 30 23:04:25.670125 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:25.670093    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-ckfcw_1d2ccf23-0efa-409e-8815-c53ea93de343/manager/0.log"
Oct 30 23:04:26.290561 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:26.290529    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6545b48489p5m4v_ab30c3fd-f2e8-413e-b837-c295e91f4f84/istio-proxy/0.log"
Oct 30 23:04:27.573531 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:27.573494    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-76597d6855-62dtc_8c139cbd-4b47-41c0-b11f-742a3ff3f81b/istio-proxy/0.log"
Oct 30 23:04:28.689675 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:28.689646    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-76597d6855-shttj_9540d501-45f8-42fb-b3e3-da60a19f9301/istio-proxy/0.log"
Oct 30 23:04:29.297246 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:29.297212    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-76597d6855-vfb7s_5c149d2a-e6e0-45fd-978d-a1d5c0137d79/istio-proxy/0.log"
Oct 30 23:04:29.573717 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:29.573687    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-76597d6855-x6hg4_d804a5f8-76b1-4ac5-bef4-ab73965299f6/istio-proxy/1.log"
Oct 30 23:04:30.133806 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:30.133775    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-77d8c79567-47fhw_d035a377-67b0-4288-8b37-329883c8b58d/istio-proxy/0.log"
Oct 30 23:04:30.853970 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:30.853942    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5c6c4f6cbf-rnprt_fb977621-3d73-4a48-bc4c-a50f67da25d6/router/0.log"
Oct 30 23:04:31.453665 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:31.453634    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-6z7d9_a7f24980-650b-47e6-9d86-2cf74f4f105d/main/0.log"
Oct 30 23:04:31.947153 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:31.947124    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-dzjzr_2b034e42-8bd5-4442-a7e8-04185f498f2a/main/0.log"
Oct 30 23:04:32.179047 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:32.179014    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-jdp6j_3a3a3ab7-f8a6-4d58-a199-ae4c3e4b844a/main/0.log"
Oct 30 23:04:32.402516 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:32.402484    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8j4qf4_bc19019e-af7f-43bc-8de8-670e7ef903f4/main/0.log"
Oct 30 23:04:33.116150 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:33.116121    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-scc9k_0f21c3e9-0a4e-4cef-8cdc-9546bd9cd97f/main/0.log"
Oct 30 23:04:39.593451 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:39.593413    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:04:43.160466 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:04:43.160429    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 23:04:46.043798 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:46.043765    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 23:04:46.055936 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:04:46.055910    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-57lx9_9d85ad48-ac81-4f99-83d9-9e93db301d40/console-operator/2.log"
Oct 30 23:05:01.672856 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:05:01.672815    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-687b4b7474-nmhzz_e900fb86-08e5-49bd-bb58-6e919e6588e0/manager/0.log"
Oct 30 23:05:02.273707 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:05:02.273665    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-687b4b7474-nmhzz_e900fb86-08e5-49bd-bb58-6e919e6588e0/manager/0.log"
Oct 30 23:05:13.160477 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:05:13.160438    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 23:05:39.988635 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:05:39.988527    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:05:40.271715 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:05:40.271635    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-687b4b7474-nmhzz_e900fb86-08e5-49bd-bb58-6e919e6588e0/manager/0.log"
Oct 30 23:05:40.796042 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:05:40.796003    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-687b4b7474-nmhzz_e900fb86-08e5-49bd-bb58-6e919e6588e0/manager/0.log"
Oct 30 23:05:42.139215 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:05:42.139170    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:05:42.355351 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:05:42.355306    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:05:43.160716 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:05:43.160683    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 23:05:51.182724 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:05:51.182690    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2hjmh_5981da65-938a-4058-b3cb-459025feb5d6/global-pull-secret-syncer/0.log"
Oct 30 23:05:53.105567 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:05:53.105539    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-bhpxt_391964ff-6e62-49e9-89ca-a11cc36d5753/connection-checker/0.log"
Oct 30 23:05:53.529039 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:05:53.528963    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-d9h59_8a9727e5-7f30-4be7-bc31-9a2af5b0d21e/connection-checker/0.log"
Oct 30 23:05:53.955236 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:05:53.955209    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-x9kk6_b7d2b389-602c-4ef9-a4eb-2caf80e330d0/connection-checker/0.log"
Oct 30 23:05:54.428343 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:05:54.428317    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log"
Oct 30 23:05:55.904489 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:05:55.904455    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-32.us-west-1.compute.internal_13606120155d66241850ec4f52f0e0f4/haproxy/0.log"
Oct 30 23:06:00.926470 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:00.926433    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6859d556b5-bq4vb_845284a3-14ec-44c3-b284-ab3fd6b086c3/authorino/0.log"
Oct 30 23:06:01.252362 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.252285    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-5s6rv_799ab849-b5eb-4121-b968-daac6c0ca192/manager/0.log"
Oct 30 23:06:01.372888 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.372858    5258 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"]
Oct 30 23:06:01.373329 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.373313    5258 cpu_manager.go:414] "containerMap: removing container" podUID="0c880ef8-e265-4af5-9d0c-8915c3c15417" containerName="maas-api"
Oct 30 23:06:01.373423 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.373331    5258 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c880ef8-e265-4af5-9d0c-8915c3c15417" containerName="maas-api"
Oct 30 23:06:01.373484 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.373471    5258 memory_manager.go:365] "RemoveStaleState removing state" podUID="0c880ef8-e265-4af5-9d0c-8915c3c15417" containerName="maas-api"
Oct 30 23:06:01.376777 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.376761    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.430483 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.430460    5258 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qhgmw\"/\"default-dockercfg-zvzwl\""
Oct 30 23:06:01.478855 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.478817    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qhgmw\"/\"kube-root-ca.crt\""
Oct 30 23:06:01.478855 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.478828    5258 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qhgmw\"/\"openshift-service-ca.crt\""
Oct 30 23:06:01.481324 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.481303    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"]
Oct 30 23:06:01.483299 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.483279    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e432f782-e1f0-4184-b990-709c052a6675-lib-modules\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.483360 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.483328    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqfmj\" (UniqueName: \"kubernetes.io/projected/e432f782-e1f0-4184-b990-709c052a6675-kube-api-access-mqfmj\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.483562 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.483547    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e432f782-e1f0-4184-b990-709c052a6675-proc\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.483617 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.483609    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e432f782-e1f0-4184-b990-709c052a6675-podres\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.483698 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.483687    5258 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e432f782-e1f0-4184-b990-709c052a6675-sys\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.585167 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.585144    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e432f782-e1f0-4184-b990-709c052a6675-podres\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.585306 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.585186    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e432f782-e1f0-4184-b990-709c052a6675-sys\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.585306 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.585235    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e432f782-e1f0-4184-b990-709c052a6675-lib-modules\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.585306 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.585259    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqfmj\" (UniqueName: \"kubernetes.io/projected/e432f782-e1f0-4184-b990-709c052a6675-kube-api-access-mqfmj\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.585306 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.585264    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e432f782-e1f0-4184-b990-709c052a6675-podres\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.585306 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.585288    5258 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e432f782-e1f0-4184-b990-709c052a6675-proc\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.585478 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.585318    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e432f782-e1f0-4184-b990-709c052a6675-sys\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.585478 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.585341    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e432f782-e1f0-4184-b990-709c052a6675-proc\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.585478 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.585351    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e432f782-e1f0-4184-b990-709c052a6675-lib-modules\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.647602 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.647557    5258 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqfmj\" (UniqueName: \"kubernetes.io/projected/e432f782-e1f0-4184-b990-709c052a6675-kube-api-access-mqfmj\") pod \"perf-node-gather-daemonset-ql4mm\" (UID: \"e432f782-e1f0-4184-b990-709c052a6675\") " pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:01.670613 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.670579    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-mssbp_3f26245d-8748-43ec-b93b-aae4d677f50a/manager/0.log"
Oct 30 23:06:01.689118 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:01.689096    5258 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:02.074632 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:02.069793    5258 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"]
Oct 30 23:06:02.532545 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:02.532447    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm" event={"ID":"e432f782-e1f0-4184-b990-709c052a6675","Type":"ContainerStarted","Data":"a8d57660660814b0fa0ca8b3f23181ae1df94f8e63f7a75f49251828c7db960c"}
Oct 30 23:06:02.532545 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:02.532513    5258 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm" event={"ID":"e432f782-e1f0-4184-b990-709c052a6675","Type":"ContainerStarted","Data":"d906369872031c4b521f8edafa56f3db7b81d544baf794e8b7c524c5fcc9ed02"}
Oct 30 23:06:02.532834 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:02.532564    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:02.561098 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:02.561067    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-tr8h9_dc7af4e1-189e-4dd1-9bc7-c4790560a76c/manager/0.log"
Oct 30 23:06:02.650328 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:02.650270    5258 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm" podStartSLOduration=1.6502570840000002 podStartE2EDuration="1.650257084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:06:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:06:02.649335412 +0000 UTC m=+4277.380192556" watchObservedRunningTime="2026-10-30 23:06:02.650257084 +0000 UTC m=+4277.381114226"
Oct 30 23:06:02.941147 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:02.941116    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-wpvvx_87aca691-d489-4340-bba8-c2a24ef6b01a/limitador/0.log"
Oct 30 23:06:03.440229 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:03.440201    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-ckfcw_1d2ccf23-0efa-409e-8815-c53ea93de343/manager/0.log"
Oct 30 23:06:08.549852 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:08.549822    5258 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qhgmw/perf-node-gather-daemonset-ql4mm"
Oct 30 23:06:09.042352 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:09.042317    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-qvvd7_1f4fae7b-7758-422b-9271-451c4904c76e/cluster-monitoring-operator/0.log"
Oct 30 23:06:12.966848 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:12.966811    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvq68_b59f60e7-6f19-45d0-a0f3-8c7b4da00298/node-exporter/0.log"
Oct 30 23:06:13.160886 ip-10-0-137-32 kubenswrapper[5258]: E1030 23:06:13.160850    5258 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-s6x2r" containerName="extractor"
Oct 30 23:06:13.496499 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:13.496469    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvq68_b59f60e7-6f19-45d0-a0f3-8c7b4da00298/kube-rbac-proxy/0.log"
Oct 30 23:06:13.914893 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:13.914866    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bvq68_b59f60e7-6f19-45d0-a0f3-8c7b4da00298/init-textfile/0.log"
Oct 30 23:06:17.146491 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:17.146453    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:06:17.369419 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:17.369364    5258 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hjj9v_84f02cd4-68fb-43b2-bb98-86f2fd944aad/konnectivity-agent/0.log" limit=1024
Oct 30 23:06:24.229395 ip-10-0-137-32 kubenswrapper[5258]: I1030 23:06:24.229361    5258 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6545b48489p5m4v_ab30c3fd-f2e8-413e-b837-c295e91f4f84/istio-proxy/0.log"